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ABSTRACT 


The  problem  of  forcasting  technological  change  is  investigated.  Machines 
and  computer  programs  having  "problem  solving"  capabilities  are  examined 
to  determine  their  usefulness  in  aiding  or  replacing  the  human  forecaster. 

The  literature  on  human  problem  solving  was  also  reviewed.  The  following 
conclusions  were  reached: 

1.  The  nature  of  the  forecasting  problem  precludes  the  use  of  computer- 
type  problem  solvers  developed  to  date. 

2.  The  application  of  information  science  techniques,  namely;  descriptors 
representing  technological  concepts,  the  forces  acting  to  change  the 
technology  and  the  laws  governing  the  change,  appear  to  offer  the  most 
promise  in  assisting  the  human  forecaster. 

Accordingly,  a  quaslmathematical  model  was  developed  using  matrix 
notation  to  describe  a  technology.  An  example  of  a  forecast  of  computer 
technology  made  several  years  ago  is  included. 
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THE  EVALUATION  OF  TECHNIQUES  AND  DEVICES  AS  APPLIED 


TO  PROBLEM  SOLVING 

1.  SUMMARY  OF  THE  STUDY  AND  RECOMMENDATIONS 


This  is  the  final  report  of  a  study  project  on  the  prediction  of  technological 
breakthroughs.  The  Purchase  Request  PR  No.  63-317,  Rome  Air  Development 
Cei  ter.  referred  to  the  study  under  the  hoading  used  above  as  the  title  of  this 
report  1  ut  requested  "engineering  services  to  perform  an  evaluation  of  moni¬ 
toring  scientific  information  to  predict  technological  breakthroughs  in  advance. 
The  first  objective  of  this  effort  shall  bo  to  define  the  problem  solving  task  — 
of  predicting  technological  breakthroughs  in  specific  and  measurable  terms  . . . 
The  second  objective  is  to  conduct  an  investigation  of  those  schemes . . .  which 
appear  promising  as  replacements  for  the  human  problem  solving  activity . . . 
Finally,  the  investigator  shall  describe  the  research  program  required  to 
develop  and  evaluate  those  techniques . . . . " 

The  proposal  submitted  by  The  Moore  School  of  Electrical  Enginee  ring. 
University  of  Pennsylvania,  provided  for  engineering  aorvicee  for  ana  year  on 
tie  evaluation  of  techniques  and  drvioss  as  allied  to  problem  solving.  The 
sfcjdy  was  to  bo  pursued  in  the  following  four  overlapping  /'.mans: 

(1)  a  comprehensive  literature  review  of  psychological  research  into 
problem  solving,  decision  making,  invention  and  insight,  and  computer 
research  into  heuristic  programming,  artificial  intelligance,  and 
self-organising  systems, 

(2)  foe  description,  definition  and  identification  of  foe  qualitative  features 
of  creative  thinking  and  problem  solving, 

(3)  a  critical  review  and  evaluation  of  foe  potentials  of  electromechanical 
substitutes  for  human  problem  solving,  and 

(4)  foe  preparation  of  a  detailed  program  of  research  aimed  at  imple¬ 
ment!.^  foe  better  potential  substitutes  evaluated  in  phase  fores. 

Results  of  the  first  three  phases  form  foe  body  of  sections  2,  3,  and  4.  The 
fourth  phase  was  omitted  at  foe  written  request  of  foe  sponsor  to  permit  a 
greater  expenditure  of  time  and  effort  on  foe  first  objective  of  f  e  PR.  Other 
changes  in  direction  were  requested  by  foe  sponsor  (hiring  the  course  of  foe 
study,  leading  to  examination  of  additional  topics.  Results  of  foe  added  studies 
are  reported  in  sections  S  through  8. 
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Work  begin  with  a  delineation  of  the  following  three  areas  of  study: 

(1)  the  characterization  of  the  creative  abilities  of  individuals  and  groups 
of  people  and  of  their  motivations  to  attain  the  goals  of  society,  of  its 
science,  and  of  its  technology, 

(2)  the  application  of  computers  to  problem  solving,  as  well  as  to  self¬ 
organizing  techniques  and  the  study  of  learning  abilities, 

(3)  mathematical  techniques  of  prediction  theory,  including  statistical 
measures. 

Major  emphasis  during  the  first  half  of  the  project  was  placed  upon  the 
most  relevant  aspect  of  the  second  study  area,  namely,  mechanized  problem 
solving  procedures  as  an  element  of  technological  forecasting.  The  stat«  of  the 
art  was  reviewed  and  structured  and  a  number  of  conclusions  were  drawn. 
Results  of  this  work  are  discussed  in  section  2. 

At  the  same  time,  a  search  rx.J  critique  of  the  literature  on  (1)  human 
problem  solving  and  (2)  creativity  was  initiated.  These  studies  continued 
through  the  course  of  the  project  and  their  results  are  described  in  chapters  3 
and  4. 

A  change  in  direction  during  die  second  quarter  called  for  assessing  and, 
where  possible,  describing  the  techniques  used  by  human  analysts  in  perform¬ 
ing  the  prediction  function,  with  a  view  to  mechanisation.  The  sponsor  sug¬ 
gested  that  greater  emphasis  be  placed  upon  the  human  forecasting  aspects  of 
the  study  while  reducing  emphasis  on  mechanical  considerations. 

In  particular,  research  was  initiated  on  descriptive  task  analysis  of  human 
creativity  and  human  problem  solving.  This  was  recognized  as  a  formidable 
task;  however,  a  model  was  conjectured  as  a  basis  for  the  study.  The  model 
Is  described  in  section  5.  It  appeared  that  gaming  would  be  useful  to  obtain 
experimental  data  for  firming  up  the  model.  The  use  of  gaming  is  discussed 
in  section  8;  It  appears  to  have  value  beyond  the  determination  of  human  fore¬ 
casting  procedures,  and  particularly  in  developing  formal  mechanizable  fore¬ 
casting  techniques  of  the  type  now  to  be  described. 

From  the  study  of  machine-oriented  problem  solving,  it  became  clear 
that  certain  elements  of  forecasting  were  omitted  from  machine-oriented 
problem  solvers  described  to  date;  the  latter  dealt  with  problems  having 
(at  a  single  specified  goal  to  be  reached  from  (b)  known  initial  conditions 
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in  accordance  with  (c)  explicitly  prescribed  rules.  On  the  other  hand, 
effective  tee'mological  forecasting  is  characterized  by: 

(1)  unspecified  and  subjectively  indeterminate  goals, 

(2)  multiplicity  of  potential  goals, 

(3)  incomplete  knowledge  of  the  initial  state  of  technology, 

(4)  incomplete  knowledge  of  the  forces  being  applied  to  the  present  state 
of  technology,  and 

(5)  incomplete  knowledge  of  the  laws  of  change,  1.  e.  the  effects  of  the 
various  applied  forces  on  the  state  of  technology. 

It  soon  became  clear  that  die  Incomplete  knowledge  of  initial  state  of 
technology,  forces  and  laws  of  change  was  partly  due  io  the  lack  of  precise 
delineation  of  these  factors.  Formulation  of  precise  delineations  appears  to 
require  the  application  of  techniques  from  information  science,  especially  the 
use  of  descriptors  representing  technological  concepts  and  relevant  attributes 
of  motivating  forces.  The  laws  of  change  can  then  be  applied  by  linking  and 
associating  the  technology  and  force  descriptors  through  synonymic,  generic, 
conceptual,  interdisciplinary,  and  other  relationships. 

As  mentioned,  the  descriptive  techniques  need  to  be  applied  not  only  to  the 
state  of  technology  but  also  to  the  motivating  forces  such  as  the  activities  of 
scientists,  political  leaders,  and  other  key  tadtriduala;  the  goals  of  research 
and  development  organizations;  the  occurrence  of  meetings  among  key  indi¬ 
viduals  and  the  sipiifloanoe  of  meeting  plnoeet  ec'mtiftc,  economic,  and 
political  objectives  and  evens;  etc.  This  calls  for  advanced  application  of 
information  storage  and  retrieval  techniques,  not  only  to  the  manipulation  of 
documents  but  also  to  the  information  and  hUeUlgnaoe  oentained  in  the 
documents. 

The  word  "document"  here  refers  to  aay  available  message  relevant  to  the 
pertinent  technology.  Unfortunately,  relevance  cannot  always  be  determined  in 
advance;  it  often  manifests  Itself  only  after  an  appreciation  of  technological 
developments  has  been  ga^ed.  A  discussion  of  the  application  of  advanced 
information  retrieval  techniques  Is  praamtsd  In  section  6. 

As  a  simple  example  of  the  application  c  f  information  science,  a  mathe¬ 
matical  model  was  developed  during  the  third  quarter  which  defined  techno¬ 
logical  breakthrough  as  an  extremely  rapid  change  in  the  state  of  technology. 
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The  state  St  at  time  t  Is  described  by  one  or  more  Information  matrices; 
essentially,  these  are  selective  projections  of  the  total  network  description  of 
technology  (as  described  in  section  6)  onto  two-dimensional  surfaces.  The 
particular  example  described  In  section  7  summarizes  a  successful  techno¬ 
logical  forecast  made  some  years  ago  for  purposes  of  market  planning.  It. 
happens  tc  be  an  active  two-party  competitive  model,  i.  e.  one  in  which  the 
first  party  (the  forecaster)  can  influence  developments  in  the  hope  of  gaining 
advantage  over  the  second  party.  In  any  case,  it  demonstrates  a  particular 
application  of  techniques  for  information  association  in  matrix  format  for  the 
purpose  of  technological  forecasting  in  a  semimechanical  manner.  The  matrix 
model  is  described  in  section  7. 

It  is  clear  from  the  foregoing  that  progress  has  been  made  in  understanding 
the  elements  of  technological  forecasting  and  that  techniques  for  accomplishing 
mechanized  forecasting  have  been  suggested.  These  techniques  need  to  be 
tested  and  refined.  A  possible  approach  is  through  game  playing,  which  can 
also  be  used  to  study  forecasting  strategies  by  humans.  A  sketch  of  the  rele¬ 
vant  aspects  of  gaming  is  presented  in  section  8. 

As  often  occurs  in  studies  where  the  underlying  problems  are  more  com¬ 
plex  and  intractable  than  initially  anticipated,  there  was  a  fair  amount  of 
searching  for  the  significant  areas  of  research,  both  *>v  the  study  group  and  by 
the  sponsor.  As  a  consequence,  the  study  was  wider  in  scope  and  less  inten¬ 
sive  than  originally  anticipated.  Nevertheless ,  important  progress  has  been 
achieved. 

The  elements  of  technological  forecasting  are  now  better  understood.  For 
example,  the  forecasting  model  Is  now  recognized  to  be  an  iterative  model, 
moving  forward  from  8^  to  Sf+i  to  8^2  . . . ,  and  using  continuous  prediction 
techniques.  On  the  other  hand,  breaUhrough  forecasting  Is  disjunctive,  simi¬ 
lar  in  character  to  the  kind  of  heuristic  (and  hence  sometimes  erroneous)  fore¬ 
casting  practised  by  science  fiction  writers,  soothsayer and  visionaries. 
Heuristic  forecasts  are  conjectures  based  upon  incomplete  knowledge,  and 
hence  with  subjectively  evaluated  credibility  subject  to  fo  re  confirmation. 
There  can  of  course  be  disjunctive  forecasts  of  some  elements  in  an  otherwise 
iterative  forecast;  for  example,  the  development  of  a  civilization  is  usually 
iterative  but  with  elements  in  the  civilization  advancing  disjunctively. 

It  appears  that  the  most  promising  avenue  toward  mechanization  of  fore¬ 
casting  is  through  the  use  of  information  science  techniques,  by  characterizing 
the  "significant"  parameters  of  a  specified  area  of  technology  (device,  concept, 
system,  or  process),  the  forces  acting  to  advance  or  retard  that  area,  and  the 
laws  governing  the  cha  »ges  in  technological  state.  Associated  with  the  de¬ 
scriptions  of  the  forces  and  the  laws  of  change  are  certain  measures  of 


relevance  to  the  technology  and  of  interdependence  among  the  descriptive 
parameters,  as  well  as  the  interaction  rules  and  their  dynamics. 

It  is  now  evident  that  more  time  might  profitably  have  been  spent  in  con¬ 
ference  with  analysts  accomplishing  forecasting  tasks,  and  would  in  fact  be 
particularly  effective  now  the  t  the  structure  of  the  forecasting  problem  is 
better  understood.  The  result  would  be  a  sharper  definition  of  toi  jcasting 
dynamics,  research  objectives  and  specific  tasks  to  be  accomplished. 

As  a  logical  continuation  of  this  study,  the  investigator  recommends  that: 

(1)  the  iterative  model  described  in  nsctio.'  7  and  its  formal  extension 
using  the  information  science  techniques  described  In  section  6  should 
be  applied  in  a  technological  area  of  strong  interest  to  die  sponsor; 

(2)  the  model  should  be  tested  in  that  area,  refined,  and  generalized; 

<3;  games  should  be  designed  and  played  to  test  the  model  and  to  guide  its 
development  and  refinement;  and 

(4)  the  search  for  other  forecasting  models  should  be  continued. 


2.  MACHINE-OtKNTEO  PROBLEM  SOLVING 


2.1  INTRODUCTION 

In  recent  years  there  has  been  widespread  investigation  into  the  are.  f 
wMt  is  termed  "Artifical  Intelligence."  Toward  this  end.  various  schemes 
have  been  advanced  for  devices  which  are  capable  of  solving  certain  types  of 
problems  of  varying  degrees  of  complexity.  Interesting  problem-solving 
devices  attempt  solution  to  prohlems  for  which  no  formal  solution  procedure 
or  algorithm  is  known.  These  devices  employ  "heuristic"  or  empirical  rules, 
which  either  produce  a  shortcut  to  solution  or  no  solution  at  all.  The  more 
advanced  problem-solving  schemes  employ  learning  devices  which  permit  the 
overall  problem  solver  to  improve  itself  with  experience. 

A  survey  and  comparison  of  the  various  problem-solving  schemes  is  made, 
both  of  specific  problem  solvers  and  of  general  models.  A  discussion  of 
learning  and  learning  schemes  follows. 

A  problem  consists  of  three  sets  of  entities,  a  set  oi  initial  objects  (axioms, 
postulates,  "facts,"  state  of  existence),  a  set  of  operating  rules  ("moves," 
operations,  transformations,  manipulations),  and  a  goal  description  (final 
states,  desirable  terminal  conditions,  winning  configurations).  A  valid  solu¬ 
tion  to  a  problem  consists  of  successive  application  of  the  operating  rules  to 
the  initial  conditions  in  such  a  way  that  the  goal  description  is  satisfied.  A 
problem  does  not  necessarily  have  a  valid  solution  and  it  may  have  more  than 
one. 


A  trivial  problem  consists  of  small  sets  of  initial  conditions  and  operating 
rules  which  combine  In  a  necessarily  small  number  of  ways.  All  possible 
combinations  of  these  Initial  conditions  and  rules  can  then  be  examined,  so  that 
if  any  valid  solutions  exist,  they  will  be  discovered.  This  procedure  is  known 
as  solution  by  exhaustive  search.  An  example  of  a  trivial  problem  is  illustrated 
in  Figure  2.1  which  is  a  simple  mase  in  which  the  Initial  condition  is  "you  are 
in  state  A,"  the  single  rule  is  "you  may  move  from  any  state  to  any  other  state 
which  is  connected  to  it  by  a  line,"  and  the  goal  description  is  "to  be  in  state 
B."  Clearly,  an  exhaustive  search  is  feasible. 

A  more  interesting  problem  is  one  which  is  not  trivial,  that  is,  one  in 
which  an  exhaustive  search  for  the  solution  is  not  possible  because  of  time, 
storage,  and/or  energy  limitationa.  If  such  a  problem  has  not  been  solved 
before,  and  a  valid  solution  is  not  known,  one  must  turn  to  Inexact  methods  to 
attempt  solution. 


6 


To  characterize  the  problem  of  predicting  technological  breakthroughs  in 
terms  of  proolcm  solving  by  machine,  three  levels  of  problem  complexity  are 
distinguished  here.  At  the  simplest  level,  the  objects  are  named  and  the 
axioms  or  rules  are  specified  in  advance  and  the  goal  is  identified  in  an  explicit 
statement.  The  problem  is  simply  to  And  a  path,  preferably  but  not  necessarily 
close  to  the  minimum  path,  from  the  given  objects  and  rules  to  the  proof  or 
disproof  of  the  statement.  A  problem  solving  machine  at  this  simplest  level  is 
simp''-  a  "proving  machine."  A  typical  example  is  the  propositional  calculus 
problem  solver  illustrated  in  Figures  2.2,  2.3,  and  2.4.  Note  that  this  level  ot 
problem  solving  corresponds  to  specifying  A  and  B  in  Figure  2.1,  with  the 
further  assumption  that  all  paths  eventually  lead  to  B. 

In  the  second  level  of  problem  solver,  the  task  is  rendered  more  difficult 
because  the  goal  is  specified  as  a  general  statement,  such  as  "win  the  game. " 
The  objects  are  named  as  before  but  only  the  primitive  rules  are  specified. 
Typical  examples  are  checkers  and  chess,  the  major  difference  between  the 
two  being  the  implicitly  greater  complexity  of  the  latter.  Both  games  permit  a 
large  variety  of  alternatives  at  each  move,  with  exponentially  growing  alterna¬ 
tives  possible  at  each  successive  move,  as  indicated  in  Figure  2.5.  Look¬ 
ahead  to  every  achievable  eventuality  la  Impractical,  if  not  impossible,  even 
with  the  fastest  computing  machines  proposed  to  date.  The  number  of  ways  in 
which  the  game  can  be  won,  particularly  in  chest,  precludes  the  strategy  of 
aiming  for  a  small  number  of  specified  goals.  The  usual  approach  is  to  derive 
composite  or  heuristic  rules  ("control  the  center  of  the  board,"  "don't  move 
the  queen  until  position  has  ben  established")  to  spaed  tbs  look-ahead  process 
by  limiting  alternatives,  even  at  the  risk  of  oocaskmal  poorer  moves.  The 
complexity  of  die  problem  and  the  multiplicity  of  acceptable  solutions  charac¬ 
terize  this  seoond  level  of  problem  solver. 

In  the  third  and  most  difficult  level  of  problem  solving,  tbs  objects  are  not 
all  named,  the  rules  are  only  partially  specified,  and  tbs  goal  is  only  vaguely 
stated.  There  may  be  more  than  one  valid  solution.  Moreover,  valid  solu¬ 
tions  may  not  be  rsoopdasd;  they  may  in  soma  oases  sot  even  be  recognisable 
in  the  absence  of  added  information  or  pragmatic  interpretation.  Irrelevant 
Information  may  be  provided  and  part  of  tba  problem  may  be  the  (pragmatic) 
evaluation  of  Information  relevaaoe.  Mechanised  problem  solvers  at  this  level 
have  not  been  described  in  the  open  literature.  Nevertheless,  this  Is  foe  level 
of  problem  solving  required  for  predicting  technological  breakthroughs. 

Because  of  the  pragmatic  considerations,  it  is  lihsly  that  advances  in  this  area 
will  be  aided  by  developments  in  mechanized  intelligence  retrieval  or  in  foe 
somewhat  more  easily  mechanised  document  and  information  retrieval  field. 
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2.2  THE  STATEMENT  OF  PROBLEMS 


A  problem  statement  may  be  either  formal  or  informal.  A  formal  problem 
statement  is  one  in  which  each  of  the  three  entities  comprising  the  problem 
(initial  conditions,  operating  rules,  goal  description)  is  explicitly  stated,  so 
that  they  comprise  a  completely  defined  set.  This  set  is  identical  for  the 
problem  stater  and  the  problem  solver.  The  size  and  complexity  of  the  problem 
is  irrelevant.  An  example  of  a  formal  problem  might  be:  "Given  all  the  rules 
of  chess  as  the  operating  rules,  and  given  this  position  of  the  chessboard  R3  the 
initial  condition,  mate  in  three  moves."  The  goal  is  then  a  set  of  three  move 
sets,  each  of  which  leads  to  mate,  and  each  one  of  which  is  a  response  for 
certain  moves  by  the  opponent. 

An  informal  problem  is  one  for  which  the  initial  conditions  and  the  oper¬ 
ating  rules,  although  they  may  be  restricted  in  some  way  by  the  problem 
stater,  depend  upon  the  experience  and  a  priori  knowledge  of  the  problem 
solver.  It  is  the  informal  problem  which  is  most  generally  encountered  by 
human  beings,  and  which,  at  least  at  present,  can  only  be  solved  by  human 
beings.  Deterministically,  the  initial  conditions  of  the  problem  include  the 
state  of  the  problem  solver,  although  this  state  is  not  (entirely)  known  tc  the 
problem  stater.  Nevertheless,  the  problem  stater  need  not  state  all  conditions 
and  rules  of  the  problem,  foi  be  knows  that  the  problem  solver  is  already 
aware  of  many  of  them  b-  some  form  or  other.  An  example  of  an  informal 
problem  might  be  "Go  to  the  movies."  Inherent  in  this  problem  is  donning  the 
proper  attire  for  the  theater  in  question,  acquiring  the  necessary  fee  and 
transportation  to  the  theater,  getting  there  at  the  correct  time  for  the  show, 
etc.,  etc.  The  problem  solver  need  not  follow  the  course  of  action  that  the 
problem  stater  would  have,  nor  could  the  problem  stater  have  predicted  this 
course  of  action  accurately. 

Goal  statements  are  also  generally  incomplete  in  Informal  problems,  and 
the  solver  is  expected  to  complete  or  interpret  them.  The  example  "Clean  the 
house"  illustrates  a  problem  statement  for  which  there  might  be  differences  of 
opinion  as  to  whether  more  specifically  stated  goals  apply.  Would  "Sweep  the 
floors"  be  sufficient  to  fit  the  goal  description  "Clean  the  house?"  This 
depends  on  the  solver,  and  yet  problems  (informal  ones)  are  often  stated  in 
this  way. 

2.3  THE  HEURISTIC  APPROACH 

When  a  problem  solver  has  been  active  for  a  while,  he  will  presumably 
have  met  with  some  successes  and  some  failures.  If  these  are  recorded, 
successes  may  be  repeated,  and  failures  possibly  averted  when  identical  situ¬ 
ations  recur.  Further,  rules  may  be  abstracted  from  similar  situations  to 
assist  in  proper  choice  of  method  of  solution.  These  empirical  rules  are  called 
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heuristics.  A  heuristic  is  an  empirical  rule  which,  in  s  given  problem  situa¬ 
tion,  favors  certain  approaches  over  others.  The  application  of  heuristics  to 
a  problem  which  cannot  be  solved  exhaustively  makes  solution  possible  within 
available  resources.  The  heuristic  approach  does  not,  however,  guarantee  the 
discovery  of  all,  or  even  any  solutions.  The  better  the  heuristic,  the  higher 
the  probability,  in  a  given  situation,  that  its  application  will  yield  the  (or  a) 
correct  path  toward  a  valid  solution. 

A  problem  solver  /ho  is  able  to  record  and  learn  from  his  experience, 
and  subsequently  construct  and  test  new  heuristics  is  obviously  superior  to  one 
who  is  not  able  to  do  so.  A  heuristic  is,  by  definition,  an  imperfect  procedure 
for  problem  solving.  A  procedure  which  always  yields  a  solution  for  a  specific 
type  of  problem  is  known  as  a r  algorithm.  An  algorithm  is  preferable  to  a 
heuristic,  but  for  most  problems,  algorithms  do  not  exist.  For  very  complex 
problems,  heuristics  improve  with  experience. 

An  example  of  a  heuristic  in  chess  might  be  "take  an  opponent's  piece 
when  you  are  able."  This  heuristic  might  be  useful  in  some  instances  but 
disastrous  in  others.  An  improved  heuristic  might  be  "take  an  opponent's 
piece  when  you  are  able,  rnless  you  will  lose  more  valuable  pieces  in  an 
exchange."  Still  other  improvements  are  possible. 

Heuristics  are  often  arranged  in  a  hierarchy,  so  that  when  more  than  one 
applies,  the  one  which  is  most  likely  to  yield  a  valid  solution  within  the  situa¬ 
tion  will  be  applied. 

2.4  THE  FORMAL  PROBLEM 

Numerous  investigations  have  bean  made  into  nonhuman  problem  solving 
devices.  The  only  feasible  method,  at  present,  for  the  construction  of  these 
devices  is  through  the  u*e  of  e  general  purpose  digital  computer.  Most  of  the 
investigations  have  restricted  themselves  to  epootaHesd  problem  solvere  which 
operate  within  a  very  specific  area,  that  Is,  which  soles  only  one  specific  type 
of  problem.  Only  formal  problems  haws  been  discussed  extensively  to  date. 
Formal  problem  solvere  lend  themselves  to  construction  on  digital  computers, 
for  an  explicit  set  of  operating  rales  can  be  symbolically  represented,  as  well 
as  the  initial  conditions  and  the  goal  description.  The  hierarchy  of  heuristics 
built  into  the  problem  solver  determine  its  approach  to  the  problem.  Examples 
of  the  specialised  formal  problem  solvers  are  chase  playing  machines  (1)  (2) 
(3),  s  geometry  theorem  proving  machine  (4),  and  a  simple  propositional 
calculus  proof  machine  (6).  It  will  be  acted  that  the  set  of  operating  rules  of 
each  of  the  above  examples  is  small,  and  with  the  growth  of  a  set  of  operating 
rules,  the  possible  approaches  to  valid  solution  grows  exponentially. 


A  further  clarification  of  the  shady  difference  between  a  formal  and  an 
informal  problem  statement  can  be  given  in  terms  of  the  language  of  communi¬ 
cations.  The  hierarchy  of  computer  languages  which  exist  and  can  be  written 
today  serve  well  for  formal  problem  solving  devices  (although  the  construction 
of  memories  which  serve  efficiently  in  learning  devices  are  still  crude). 
Informal  problems,  however,  are  genet  ally  stated  in  a  human  language,  where 
meanings  of  various  symbols  are  not  only  inexact,  but  also  changing  with  time. 
A  problem  stated  in  human  language  renders  the  problem  informal.  An  example 
might  be  the  chess  heutistic:  "defend  the  king."  Unless  very  specific  strategies 
are  outlined  as  to  the  meaning  of  king  defense,  the  heuristic,  and  therefore  the 
problem  solver,  must  be  informal. 

2.5  STATIC  AND  DYNAMIC  PROBLEM  SOLVERS 

It  is  our  general  experience  that  human  problem  solvers  improve  their 
technique  with  experience,  and  it  might  very  well  be  that  this  principle  holds 
for  formal  devices  as  well,  i.e. ,  that  devices  which  are  designed  to  "learn" 
from  experience  improve  their  problem  solving  ability  beyond  the  specific 
capabilities  built  into  them  by  their  designers.  The  designers  of  each  of  the 
problem  solving  devices  discussed  in  this  paper  recognized  this  principle,  and 
discussed  "learning"  in  problem  solvers  at  least  to  some  extent.  A  problem 
solver  which  is  capable  of  changing  its  automaton  status  or  "input-output 
transfer  function"  with  time  fin  an  attempt  to  improve  its  problem  solving 
ability)  will  be  termed  a  dynamic  problem  solver.  A  dynamic  problem  solver 
is  illustrated  in  Figure  2.6. 

Static  problem  solvers  are  more  or  less  "stuck"  with  the  heuristics 
supplied  them.  These  might  be  very  good  heuristics,  and  quite  adequate  to 
validate  the  existence  of  the  problem  solver.  Heuristics  always  laid  them¬ 
selves,  however,  to  some  improvement,  and  the  ooncept  of  learning  in  a 
formal  device  merits  farther  study. 

I  .earning  is  probably  least  useful  at  the  lowest  level  described,  for  it  is 
nothing  more  than  rote.  There  are  probably  very  few  situations  in  which  this 
type  of  learning  alone  can  be  applied  directly.  A  more  practical  learning  situ¬ 
ation  Is  that  of  the  second  type,  and  is  the  one  most  discussed  by  the  authors  of 
the  various  problem  solving  devices.  The  third  level  of  learning  might  be 
termed  "abstraction  and  generalization,"  and  has  an  inherent  "self-organizing" 
quality.  It  Is  undoubtably  the  highest  level,  for  a  problem  solving  device  with 
such  a  capability  would  construct  heuristics  which  had  not  been  foreseen  by  its 
builder.  It  would  do  so  to  further  its  goal  or  "survival."^ 
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Figure  2.2.  Operator* 
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Given:  LI  "  E.(-Pz>Q) 

Obtain:  LO  •  (Qvp).K 

Goal  1:  Tranefora  LI  into  LO 

Natch  produces  position  difference  (AP). 

Goal  2:  Seduce  A  P  between  Ll  and  LO. 

Pirst  operator  found  is  Si. 

Coal  3:  Apply  Si  to  Ll. 

Goal  4:  Transfora  Ll  into  C(El). 

Hatch  succeeds  with  A  •  S  and  B  •  -P^Q. 

Produce  new  object: 

L2  -  (-P=X}).S 

Goal  5:  Transfora  L2  into  LO. 

Match  produces  connective  difference  (AC)  in  left  subexpression. 
Goal  6:  Seduce  AC  between  left  of  L2  and  left  of  LO. 

First  operator  found  is  S3. 

Goal  7:  Apply  S3  to  left  of  L2. 

Goal  8:  Transfora  left  of  L2  into  C(B5). 

Hatch  produces  connective  difference  (AC)  in  left  sub¬ 
expression. 

Goal  9:  Seduce  A  C  between  left  of  L2  and  C(E3). 

Goal  rejected:  difference  le  no  easier  than 
difference  in  Goel  6. 

Second  operator  found  ie  Bfe. 

Goel  10:  Apply  BA  to  left  of  Lt. 

Goel  11:  Tranefora  left  ef  L2  tote  C(Bd). 

Match  eueceede  with  A  •  -f  end  B  •  Q. 

Produce  new  object: 

L3  •  (PvQ).E 

Goal  12:  Tranefora  Li  Into  LO. 

Match  producer  position  difference  (  &  P)  1*  left  subexpression. 
Goel  13:  induce  AP  between  left  of  U  aad  left  ef  LO. 

Flret  operator  found  le  Bl. 

Goal  14:  Apply  Bl  to  left  ef  L3. 

Goel  15:  Trans  fora  left  of  L3  into  C(B1). 

Match  euceeeda  with  A  -  P  aad  I  ■  Q. 

Produce  new  object: 

U  -  (QvP).B 

Goal  16:  Trensfcra  IA  into  LO 

Natch  shows  L4  1c  Identical  with  LO,  QSL. 


Figure  2.4.  Example  of  Logic  Theorem  Proof 
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3.  PROBLEM  SOLVING  BY  HUMANS 


As  a  first  approach  to  a  very  complex  subject,  this  section  sets  forth 
some  definitions  and  concepts  which  prevade  most  of  the  literature  on  problem 
solving.  Like  many  other  areas  in  psychology,  there  are  no  definitive  answers 
to  be  given.  Experimentation  has  been  interpreted  in  terms  of  the  experi¬ 
menters'  own  theoretical  outlook;  the  conflict  between  S-R  and  S-S  thinking 
will  evidence  itself  in  some  of  the  theoretical  discussions  which  will  follow. 

3.1  PROBLEM-SOLVING  BEHAVIOR 

The  first  presentation  will  be  based  largely  on  W.  Edgar  Vinacke's  The 
Psychology  of  Thinking  which  appears  to  discuss  more  of  the  key  issues  in 
problem  solving  than  any  other  source  located. 

Vinacke's  first  distinction  in  setting  the  scene  for  defining  problem  solving 
behavior  is  that  mental  processors  are  bipolar  in  nature,  determined  on  the 
one  hand  by  the  external  world,  and  on  the  other,  by  inner  needs.  From 
moment  to  moment  these  influences  interplay  in  the  course  of  thought,  with 
external  stimuli  dominating  at  one  time  and  internal  stimuli  at  another.  At 
no  time  can  it  be  said  that  either  is  independent  of  the  other,  but  it  is  possible 
to  distinguish  general  conditions  under  which  one  set  of  factors  has  a  stronger 
influence  than  others.  "In  problem  situations,  the  normal  person  is  behaving 
more  in  relation  to  the  demands  made  by  the  external  conditions;  in  imaginative 
thinking,  the  individual  is  responding  more  to  the  inner-need  condition  of  the 
moment,  more  or  less  independently  of  the  external  condition. ”(P-  16Cn 
Vlnacke  then  goes  on  to  say  that  he  conceives  of  problem  solving  as  a  form  of 
thinking  beyond  the  learning  phases.  He  then  goes  on  to  develop  the  following 
schema  for  describing  human  problem  solving. 

In  analyzing  behavior  in  a  problem  solving  situation  three  stages  may 
logically  be  distinguished:  (PP*  iSi-162) 

"1.  Confrontation  by  a  problem.  In  this  first  stage,  a  situation ...  is 
present  involving  a  goal  together  with  an  obstacle  or  difficulty  between  it  and 
the  individual.  There  follows  some  realization  by  the  individual  that  such  a 
situation  exists.  Motivations  to  overcome  the  difficulty  ensues,  accompanied 
by  effort  to  attain  the  goal. " 

"2.  Working  toward  a  solution.  In  the  intermediate  periods,  the  individual 
engages  in  activity  to  relieve  the  tension  built  up  in  the  first  stage.  There  may 
be  mental  or  symbolic  processes  . . .  manipulation  and . . .  verbalization. " 
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"3.  Solution.  As  an  outcome  of  the  foregoing  activities,  the  individual  may 
reach  the  goal  or  he  may  fail  to  reach  it.  Results  in  the  individual  may  be 
understanding,  relief  of  tension,  emotional  effects  such  as  satisfaction  or 
pleasure,  a  cessation  of  activity,  or  some  modification  of  behavior.  Results 
In  the  environment  may  be  an  organization  or  reorganization  of  materials  or 
relationships,  removal  of  the  obstacle  or  a  change  in  the  situation ....  Also. . . 
failure  may  be  an  outcome ..." 

Bruner,  Goodnow,  and  Austin  in  A  Study  of  Thinking,  approach  problem 
solving  from  a  somewhat  different  framework,  but  nevertheless  their  listing 
of  primary  consideration  on  categorizing  with  probabilistic  cues  bears  some 
similarity  to  Vinacke's  schema. 

1.  Conception  of  the  task  and  of  its  final  resolution.  The  authors  of  ^ 
Study  of  Thinking  seem  to  assume  that  the  subject  is  aware  of  the  problem  but 
point  out  that  the  form  of  the  awareness  has  Implications  for  the  approach  to  it. 
If  S  views  his  task  as  one  in  which  a  final  and  unique  solution  is  possible,  "then 
his  categorizing  procedure  may  well  be  different  from  that  of  (one)  who  sees 
the  situation  as  always  and  forever  one  into  which  uncertainty  will  enter." 

"One  difference  which  tho  conception  of  the  task  makes  is  in  the  attitude  toward 
taking  a  chance  and  making  an  error.  The  Individual  who  asp -res  to  eventual 
certainty  and  who  expects  to  be  able  to  continue  categorizing  and  exploring  will 
often  risk  errors  more  readily  on  the  assumption  that  a  successful  final  solu¬ 
tion  will  negate  the  errors  incurred  along  the  way."®1*** 

2.  Presence  of  potentially  criteria!  cnee.  There  are  some  situations  in 
which  individuals  can  be  guided  only  by  the  relative  frequency  with  which 
instances  tun  out  to  belong  to  one  category  or  another  —  situations,  for 
instance,  where  there  is  such  a  poverty  of  discriminate  attributes  that  it  is 
hard  to  know  where  to  start,  hi  these  aorta  of  situations  one  observes  cue 
searching,  "an  attempt  to  find  attributes  that  oaa  he  need  as  a  basis  for  deciding 
whether  a  particular  object  should  he  piaoed  la  one  category  or  another ."(P*  18“ 

3.  Payoff  matrix  governing  categorising  decision.  If  the  individual  be¬ 
lieves  that  an  event  has  a  small  number ,  r,  of  distinct  possible  types  of  out* 
cornea,  and  if  there  are  in  his  opinion  a  small  number,  e,  of  alternative 
actions  available  to  him,  the  situation  may  be  represented  in  an  "operative 
payoff  matrix."  Both  the  extant  to  which  the  individual  likes  each  of  toe  out¬ 
comes  and  his  probability  estimates  of  their  oecurreaoee  affect  the  decision 
he  makes.  It  is  in  general  a  difficult  task  to  establish  preference  ordering  and 
probability  estimates,  and  hence  to  determine  how  a  particular  aeries  of 
decisions  is  made.  (P-  1®®) 


4.  OpporfruUty  for  validation.  One  difference  which  cam  be  observed 
between  these  two  problem  solving  situations  is  their  degree  of  generality. 
Vinacke'a  is  quite  general  while  that,  set  forth  by  Bruner,  Goodnow,  and  Austin 
is  fairly  specific,  highly  analytic  and  rational.  Those  differences  seem  to 
reflect  s  difference  in  focus  of  attention.  Obviously  one  cannot  describe  all 
problem  solving  behavior  in  terms  of  highly  rational  activity.  Vinacke  deline¬ 
ates  three  basic  varieties  of  problem  solving  behavior:  trial  and  error,  in¬ 
sight,  and  gradual  analysis.  We  shall  now  take  a  look  at  each  of  these 
mechanisms  for  problem  solving. 

3.2  TRIAL  AND  ERROR 

Woodworth  has  clearly  defined  what  he  believes  to  be  the  minimum  essen¬ 
tials  of  trial  and  error  as  revealed  by  animal  experiments.  (See  Vinacke, 
page  164.) 

"1.  A  'set'  to  reach  a  certain  goal. 

2.  Inability  to  see  any  clear  way  to  the  goal. 

3.  Exploring  the  situation. 

4.  Seeing  or  somehow  finding  leads,  possible  ways  to  reach  the  goal. 

5.  Trying  these  leads. 

6.  Backing  off  when  blocked  in  one  lead,  and  trying  mother. 

7.  Finally  finding  a  good  lead  and  reaching  the  goal. " 

hi  reality  tills  does  not  separate  trial  and  error  from  other  behavior  in  problem 
solving  situations  since  T  and  E  may  serve  as  a  prelude  to  other  modes  of 
attack.  C.  L.  Morgan  is  cited  by  Vinacke  as  pointing  out  that  "If  there  is  no 
way  to  figure  out  in  advance  how  to  solve  the  problem,  if  a  multiple,  varied 
attack  is  required  (e.  g.  to  familiarise  oneself  with  various  alternatives)  and  if 
it  is  necessary  to  go  through  preliminary  stages  before  the  whole  situation  can 
be  understood,  then  some  trial  and  *  rror,  whether  "blind"  or  not  must  occur." 
It  appears  that  Morgan  has  identified  important  dimension  of  problems  (really 
of  the  person  or  group  confronted  with  the  problem)  i.e.  whether  a  problem  is 
solvable  on  the  basis  of  a  single  action  or  whether  some  sort  of  sequential 
activity  is  required.  In  summary  it  might  be  said  that  trial  and  error  problem 
solving  is  essentially  mechanistic  in  nature  and  would  probably  appeal  strongly 
to  any  SR  theorist. 
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3.3  INSIGHT 


This  is  a  term  fraught  with  confused  meanings.  Several  diffeient  levels 
of  conceptualization  are  represented  by  this  word.  For  example  (Vinacke  page 
166): 

"1.  Insight  means  that  the  individual  understands  what  he  is  doing  or  has 
done  and  how  the  solution  was  achioved. 

2.  Insight  refers  to  a  mode  of  attack — an  approach  where  the  inner  rela¬ 
tions  of  basic  principles  are  sought  (as  contrasted  with  a  blind  attack — 
a  limited  view  of  trial  and  error). 

3.  Insight  refers  to  the  kind  of  solution  achieved,  i.e.  one  which  is 
sudden,  confident  and  complete. " 

For  our  purposes,  we  will  be  principally  concerned  with  the  second  usage — 
wherein  the  person  confronted  with  a  problem  seeks  to  understand  or  <1eflne 
inner  relations,  principles,  etc.  As  we  can  now  see,  it  is  to  thia  category  that 
one  might  assign  Bruner,  Goodnow  and  Austin's  schema  for  categorization  with 
probabiistic  cues. 

At  least  twenty  rather  distinct  characteristics  of  insight  have  bean  sug¬ 
gested.  Among  them  are  general  factors  like  the  ability  of  the  subject  to  repeat 
the  solution  readily  and  to  transfer  the  solution  or  principle  thereof  to  other 
situations.  Insight  has  been  linked  with  various  aspects  of  behavior  prior  to 
solution,  including  the  application  of  relevant  past  experience,  controlled  atten¬ 
tion,  and  foresight.  More  often,  it  is  likely  to  be  defined  in  relation  to  die  solu¬ 
tion  itself,  namely  in  terms  of  suddenness,  confidence,  completeness,  etc. 

Wolfgang  Kohler  and  Robert  M.  Texfcaa  are  credited  with  haviag  dona  tbs 
basic  experimentation  on  insight.  Their  work  on  primates  has  been  oarriod 
forward  by  other  experiments »e  and  the  Jonmay  to  the  top  of  the  phylogenetic 
order  has  now  been  made.  Oha  rspraeantattva  experiment  of  Kohler's  is  cited 
for  the  reader's  benefit. 

"1.  Using  an  Implement 

On  the  seooad  day  after  hie  arrival. . . ,  Koto  was,  as  usual,  fastened 
to  a  tree  with  a  oollar  and  chain.  A  thin  stick  was  secretly  pushed 
within  this  reach;  ha  did  not  notice  it  at  first,  than  ho  gnawed  at  it 
for  a  minute.  When  a  hour  had  elapsed,  a  banana  was  laid  upon 
the  ground,  outside  the  circle  which  his  dm  In  fo  med  a  radius,  and 
beyond  his  reach.  After  some  useless  attempts  to  grasp  it  with  his 
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hand,  Koko  suddenly  seised  the  stick,  which  lay  about  one  meter  behind 
him,  gazed  at  his  objective,  then  again  let  fall  the  stick.  He  then  made 
vigorous  efforts  to  grasp  the  objective  with  his  foot,  which  could  reach 
farther  than  his  hand,  owing  to  the  chain  being  attached  to  his  neck, 
and  then  gave  up  this  method  of  approach.  Then  he  took  the  stick  again 
and  drew  the  objective  toward  himself,  though  very  clumsily. " 

(Vinacke,  page  168) 

Is  the  behavior  just  reported  really  insight?  These  excerpts  are  quite  sugges¬ 
tive  and  are  open  to  a  variety  of  interpretations.  "For  example,  it  would  be 
easy  to  overlook  the  preliminary  behavior  of  the  animal  and  to  stress  only  the 
final  solution,  even  more  important  it  would  be  easy  to  forget  that  each  animal 
progressed  through  a  protracted  series  of  teste,  during  which  acquaintance  and 
skill  with  the  problems  and  materials  were  gradually  built  up. "  (Vinacke,  page 
170)  Likewise,  Yerkes  Congo  seemed  to  have  insightful  solutions  only  after 
considerable  preliminary  learning. 

A.  Alpert  observed  44  children  ranging  in  age  from  19  to  49  months  in  two 
series  of  standardized  situations.  "The  first  series  consisted  of  five  problems 
in  which  it  was  necessary  to  use  an  object  (a  large  block,  a  chair,  or  a  box  and 
a  block)  to  attain  a  toy  suspended  from  the  ceiling.  The  second  series  involved 
the  use  of  implements  to  reach  objects  located  at  a  distance  from  a  play  pen. " 
(Vinacke  page  171j 

Alpert  observed  four  categories  of  responses:  1.  primitive,  2.  random, 

3.  exploration  and  elimination,  and  4.  immediate  solution.  Primitive  might  be 
exemplified  by  the  child  simply  reaching  out  with  ita  hand,  with  random  (or 
rare)  exploration  and  elimination  characterized  as  tbs  deliberate  trying  out  of 
possibilities. 

Primitive  behavior  led  moat  often  to  failure  but  when  It  did  work  the  solu¬ 
tions  tended  to  be  of  the  immediate  variety.  Exploration  and  elimination  were 
associated  more  often  wttt  successes  then  failures.  Of  the  successes,  gradual 
solutions  with  oomplets  insight  were  most  frequent.  Also  It  la  noted  that 
exploration  and  elimination  led  to  more  solutions  with  sudden  insight  than  did 
other  types  of  PS  behavior.  Experiments  conducted  by  E.  A.  Matheson  and 
B.C.  Ling  with  nursery  school  children  yielded  results  very  similar  to  those 
of  Alpert. 

3.4  DUNCKER'S  EXPERIMENTS 

The  conditions  of  performance  which  interested  Duncker  were  those  asso¬ 
ciated  with  the  successful  solution  of  thought  problems.  "For  him  insightful 
signified  intelligent;  the  degree  to  which  an  individual  Is  able  to  respond  effec¬ 
tively,  l.e.  in  a  "good"  manner,  to  relevant  features  of  the  situation. "  (Vinacke, 
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page  172)  The  type*  of  problems  he  presented  might  be  found  in  adult  teste  c  f 
reasoning  ability.  He  concluded  that  the  process  of  solution  has  two  principal 
aspects:  1.  analysis  of  the  situation  anu  2.  analysis  of  the  goal.  In  essence  the 
subject  analyzes  the  situation  to  determine  whero  the  trouble  lies  and  tries  to 
find  out  -.vhat  can  be  used  to  remove  the  difficulty.  The  individual  also  analyzes 
the  goal,  and  considers  what  must  be  done  if  the  solution  is  to  be  achieved.  In 
what  is  apparently  an  attempt  to  better  define  the  interplay  between  an  individual 
and  a  problem  situation,  Duncker  talks  about  signaling.  Signaling  is  his  way  of 
identifying  the  subject's  perception  and  conception  of  a  given  problem.  The 
flexibility  required  to  solve  complex  problems  demands  that  tht  subject  be  able 
to  recenter  and  this  indeed  is  tied  in  with  the  subject's  manner  ot  perceiving 
the  problem.  Duncker  lists  seven  factors  which  may  hinder  efficient  signaling 

"1.  Lack  of  signaling:  The  model  of  search  may  be  too  vague  or  inadequate 
to  lead  to  a  perception  of  something  which  can  be  used. 

2.  Strength  of  attachment  of  some  specific  function  to  an  object  which  must 
be  used  for  some  different  function:  This  connection  may  represent  a 
pro.  erty  whicn  is  seemingly  the  only  fiuictic.-i  of  the  ol  lee*,  or  it  may 
represent  the  only  function  familiar  to  the  individual. 

3.  Fixity  of  the  required  function:  The  individual  may  be  able  to  see  only 
cne  object  as  possessing  the  real  /unction. 

4.  Necessity  for  altering  an  object:  To  fulfill  the  real  function,  it  may  be 
necessary  to  change,  or  modify,  or  reconstruct  materials  or  objects 
at  hand. 

5.  Original  function  actually  given  a*  a  fact:  An  object  may  be  present 
!r.  the  situation  in  its  proper  function,  although  it  could  be  used  in  a 
different  function. 

6.  Use  of  the  acme  object  for  one  function  Mid  later  for  e  new  function. 

7.  Poor  suitability  of  an  object,  for  a  new  function. "  (Vinacke,  page  175) 

Max  Wertheimer,  a  gectaltist,  sees  th*  processes  of  centering  and  re- 
centering  as  being  at  the  focal  points  of  productive  problem  solving  behavior, 
lb*  believes,  that  tho  subject  must  understand  the  structural  and  functional 
rblacfonshipn  of  the  situation.  Meanings  and  inner  relationships  must  be 
grasped.  He  sees  two  main  dynamic  processes  —  centering  of  attention 
upon  the  essential  elements  of  tho  problem  and  their  relation  tc  the  basic 
difficulty.  However,  to  solve  the  problem  there  must  be  some  reorganiza¬ 
tion  of  tho  elements  or  some  modification  of  already  known  principles,  with 


a  resulting  recentering  of  attention.  In  other  words,  understanding  relation¬ 
ships  existing  in  the  problem  and  previous  experience  and  flexibility  of  outlook 
and  approach  are  of  critical  importance. 

Vinacke  concluded  with  regard  to  insight  that  the  efficient  management  of 
a  present  situation  depends  upon  the  development  and  application  of  modes  of 
attack  or  appropriate  sets.  That  is,  relationship  principles,  attitudes,  methods, 
etc.  are  more  significant  than  specific  content  or  specific  operations  or  specific 
rules. 

3.5  SUMMARY  OF  VINACKE'S  VIEWPOINT 

There  seem  to  be  at  least  five  processes  which  take  place  in  human  prob¬ 
lem  solving  as  described  by  Vinacke: 

1.  Recognition  of  the  problem,  (evidence,  S's  verbalizations,  repeating 
instructions,  etc.). 

2.  Manipulation  or  exploration  of  some  kind.  This  exploration  may  be 
verbal  or  actual  overt  movement.  Sometimes  it  takes  the  form  of 
random  familiarization  with  materials  and  at  other  times  the  deliber¬ 
ate  testing  of  various  possibilities. 

3.  Analysis.  "Another  characteristic  usually  noted  is  that  the  subject 
attempts  to  formulate  the  goal  or  the  problem  or  to  work  out  the 
nature  of  the  difficulty.  Apparently  there  are  wide  variations  in  this 
behavior  ranging  from  a  highly  controlled,  rational  extreme  to  a  more 
generalized,  less  deliberate  extreme. " 

4.  Partial  dolving.  "Except  in  simple  situations,  or  in  those  in  which 
the  entire  solution  dspsods  upon  tbs  application  of  a  single  principle, 
the  solving  of  successive  steps  appears  to  be  an  integral  part  of  the 
performance." 

5.  Emotional  Responses,  dome  may  regard  emotional  responses  as 
incidents),  but  nevertheless,  the  initial  presentation  of  the  problem, 
the  activities  of  working  toward  the  solution,  and  the  solution  itself 
are  usually  associated  with  varying  emotional  reactions,  as  well  as 
with  manipulation,  formulation  of  hypotheses,  etc. 

Adding  it  all  up,  it  may  be  saki  that  human  problem  solving  as  seen  by 
Vinacke  consists  most  typically  of  the  following  processes:  apprehension  or 
recognition  of  the  problem;  manipulation  or  exploration  of  the  situation;  some 
degree  of  control  or  direction  of  performance;  the  understanding  or  mastery  of 
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intermediate  requirement*  or  steps;  and  emotional  responses  representing 
some  degree  uf  personal  involvement  in  the  situation. 

3.6  JOHNSON'S  SCHEMA 

We  will  now  sketch  the  conceptions  of  Donald  Johnson  with  regard  to  human 
problem  solving.  His  schema  of  explaining  human  problem  solving  behavior 
appears  to  emphasize  the  processes  attendant  to  the  recognition  and  preparation 
for  the  solution  of  the  problem  more  than  does  the  scheme  set  forth  by  Vinacke. 
In  a  chapter  of  his  book  The  Psychology  of  Thought  and  Judgment,  entitled, 
"Preparation  for  Thought  and  Judgment"  (page  158)  Johnson  states,  "In  solving 
these  problems  the  thinker  contributes  much  more  to  the  preparatory  set  than 
in  the  simple  forms  of  thought,  instructions  for  which  establish  a  set  that  per¬ 
mits  immediate  production  of  responses. "  In  short,  it  is  Johnson's  viewpoint 
that  the  consideration  of  the  total  problem  situation  results  in  the  problem 
solver  either  creating  in  himself  a  set  or,  in  a  sense,  perhaps  deciding  upon 
strategies  to  employ  in  the.  solution  of  the  problem  before  the  initiation  of,  in 
his  terminology,  the  production  of  responses.  Johnson  further  elaborates  by 
saying:  "In  the  complex  problems  of  human  concern,  the  goal  or  solution  may 
not  be  so  clearly  specified  that  the  thinker  can  begin  at  onoe  to  produce  tenta¬ 
tive  solutions.  The  preparation  for  thought  may  therefore  include  an  analysis 
of  the  goal  making  it  more  explicit. "  (peg*  162) 

Johnson  goes  on  to  acknowledge  font  tills  preparatory  activity  is  quite 
difficult  to  identify  in  the  complexity  of  human  behavior.  In  carrying  forward 
his  idea  that  the  human  organism  must  prepare  Itself  for  undertaking  the  solu¬ 
tion  of  a  problem,  and  must  in  particular  have  a  clear  goal  In  mind,  he  cites 
work  accomplished  by  Reid  in  1M1.  Reid  attempted  to  demonstrate  the  im¬ 
portance  of  specification  of  the  goal  by  experimental  variations  of  the  condi¬ 
tions  of  his  experiments.  Quoting  Johnson,  "He  had  oollege  students  work 
construction  problems  with  match  sticks  sad  solid  objects.  Experimental 
groups  received  a  standard  series  of  aids  daalgnari  to  explicate  the  goal,  while 
control  groups  received  a  parallel  aeriee  of  aids  without  explicatory  contents. 
For  example,  one  aid  was  as  follows:  ’R  means  that  each  match  must  form 
two  triangle  aides.  If  that  is  your  original  triangle  there  (pointing  with  finger), 
each  of  those  three  matches  is  already  existing  la  one  triangle.  How  can  you 
put  each  of  those  three  matches  into  two  triangles  at  the  same  time?’  The 
corresponding  aid  for  the  control  group  was  as  follows:  ’People  often  find 
this  problem  rather  difficult. '  Such  explication  was  helpful.  The  experimental 
group  solved  significantly  more  problems  than  the  control  groups.  There  is 
no  doubt  that  these  statements  jy  the  experimenter  were  effective  aids,  and  it 
seems  likely  that  their  effect  was  due  to  explication  of  the  goal,  at  least  it  was 
a  hypothesis  about  explications  of  the  goal  that  framed  theee  statements. " 

(page  162) 
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This  is  one  of  the  experimental  studies  on  which  Joh^on  based  his  notion 
that  a  clear  goal  is  helpful  to  subjects  in  attempting  to  solve  problems. 
Assuming  then,  that  specification  of  the  goal  is  desirable  and  necessary  for 
problem  solution,  Johnson  then  goes  to  query  what  factors  determine  how  the 
problem  is  formulated  and  how  the  goal  is  specified.  It  is  his  feeling  that 
motivation,  social  interaction  and  previous  experience  or  one  might  call  it  the 
apperceptive  mass,  all  enter  into  these  matters.  Thev  play  a  particularly 
important  role  in  the  solution  of  more  complex  problems  since  it  is  only  in 
complex  problems  that  the  specification  of  a  goal  or  the  formulation  of  a  prob¬ 
lem  is  difficult.  Indeed,  this  may  be  a  very  good  criterion  for  establishing 
problem  "difficulty." 

Johnson  goes  on  abi-ut  the  other  two  essential  elements  in  the  problem 
solving  process  known  as  the  production  process  and  judgment.  Without, 
delving  into  all  the  rati  ills  behind  his  schema,  one  can  say  that  the  produc¬ 
tion  process  is  the  activity  which  results  from  the  preparatory  phase  of  the 
solution.  This  is  when  the  subject  is  trying  to  achieve  a  solution.  As  each 
try  is  made  it  is  then  necessary  for  the  subject  to  make  a  judgment  as  to  the 
adequacy  of  the  response  he  has  made,  whether  it  be  verbal,  mechanical  or 
what  have  you.  This  judgmental  process  concludes  the  solution  of  the  problem 
if  indeed  the  subject  perceives  this  as  an  adequate  solution;  or  it  triggers  off 
another  phase  in  the  production  process  if  this  is  not  so.  In  short,  Johnson 
sees  a  preparatory  production  and  judgmental  phase  as  being  descriptive  of 
the  three  essential  phases  Involved  in  human  problem  solving.  He  particularly 
stresses  the  impact  that  the  set  generated  during  the  preparatory  phase 
on  the  ultimate  solution. 

3.7  CONCEPT  FORMATION 

Now  having  taken  e  look  at.  Johnson's  schema  for  problem  solving,  we  will 
turn  to  mother  element  In  the  problem  solving  process;  that  of  concept  forma¬ 
tion.  It  will  become  obvious  that  concept  formation  has  been  talked  about  by 
both  Vlnacke  and  Johnson  but  not  named  aa  such.  It  is  our  Impression  that  this 
ia  a  valuable  concept  and  embodies  some  aspects  not  specified  by  either 
Vlnacke  or  Johnson  and  la  therefore  worth  considering. 

Osier  and  Fivel  designed  experiments  in  concept  attainment  among  school 
childr  m  between  the  ages  of  9  and  14.  Without  delving  into  the  success  of 
these  experiments,  It  is  interesting  to  note  the  following  observations  in  their 
report.  "One  other  factor  that  may  be  related  to  performance  must  be  con¬ 
sidered.  The  instruction  given  to  subjects  did  not  direct  them  explicitly  to 
try  to  discover  a  concept,  but  merely  stated  that  attending  to  the  stimuli  would 
help  them  win.  Theoretically,  therefore,  it  is  possible  that  the  experimental 
task  consisted  of  two  stages:  (a) discovery  of  the  problem,  that  is,  that  a  concept 
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is  to  be  sought,  and  (b)  the  solution,  that  is,  the  discovery  of  the  specific 
concept."  (Osier  and  Fivel,  page  7) 

It  is  interesting  to  speculate  that  just  this  sort  of  behavior  is  probably 
found  in  most  complex  problem  solving  situations.  It  would  seem  that  this 
idea  of  concept  attainment,  that  is,  the  derivation  of  a  general  goal  and  objec¬ 
tive  from  the  variety  of  specifics  constituting  the  problem  is  a  necessary  facet 
of  problem  solving  behavior  in  the  human  organism  in  all  but  the  simplest 
problems.  It  is  further  interesting  to  consider  the  observation  made  by  the 
authors  concerning  the  two-step  process  required  for  attainment  of  the  concept 
in  their  experiment,  that  is,  that  first  the  subject  had  to  determine  that  a  con¬ 
cept  was  needed  and  then  determine  what  the  specific  concept  was  which  was 
needed  to  solve  the  problem.  It  is  highly  probable  that  almost  any  problems 
with  creative  elements  involved  in  them  require  this  same  dual  process  to 
occur. 


First,  the  person  who  is  being  subjected  to  various  stimuli  must  recognize 
the  need  for  a  particular  type  of  problem  solution  and  then  must  try  tc  achieve 
it.  Without  recognizing  the  existence  of  a  problem  'nd  identifying  it,  the  solu¬ 
tion  of  a  problem  is  impossible.  11108,  we  can  see  that  in  any  problem  that  is 
not  made  explicit  to  the  subject,  it  Is  first  necessary  for  the  subject  to  con¬ 
ceive  of  the  problem  as  existing  and  conceive  of  some  sort  of  potential  terms 
in  which  a  solution  might  be  made.  Theee  terms  in  which  a  solution  might  be 
formulated  would  probably  be  equated  to  Johnson's  goal  formulation  which  he 
spoke  of  as  taking  place  during  the  preparatory  phases  of  toe  problem  solving 
process. 

3.8  SOCIAL  INTERACTION  IN  PROBLEM  SOLVING 

Having  looked  at  quite  a  fa w  facets  of  the  problem  solving  process,  both  in 
problem  situations  which  arc  quite  highly  structured  and  having  also  considered 
the  necessary  prerequisites  for  ths  solution  of  problems  involving  somewhat 
creative  or  original  elements,  still  another  ana  will  now  be  explored.  Ibis 
urea  .a  the  ana  of  toe  effect  of  social  Interaction  upon  problem  solving.  It  is 
well  known  by  all  behavioral  scientists  tost  the  behavior  manifested  by  toe 
human  organism  in  group  situations  and  In  individual  situations  often  differs. 
Most  of  the  experimental  data  underlying  the  theories  which  have  been  discussed 
thus  far  have  been  based  on  experimentation  done  on  individual  people.  R  there  ¬ 
fore  would  seem  interesting  and  profitable  to  explore  the  impact  of  group  inter¬ 
action  on  the  problem  solving  prooesa. 

A  study  by  James  Davis  and  Frank  Restle  serves  as  a  good  basis  for 
introducing  this  topic.  (2)  in  setting  the  scene  for  this  study  Davis  and  Restle 
made  a  brief  review  of  the  field  of  group  problem  solving.  They  reported  a 
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classic  study  done  by  Shaw  in  1932  which  showed  that  groups  attained  a  higher 
proportion  of  solutions  than  individuals  and  provided  evidence  for  the  hypothesis 
that  group  interaction  facilitates  individual  cognitive  processes.  They  also 
reported  that  Lorge  and  Marguardt  in  1955  have  suggested  that  the  group  advan¬ 
tage  results  from  a  statistical  pooling  of  the  abilities  or  accomplishments  of 
their  members  and  that  some  experimental  evidence  seems  to  support  this 
assertion  (Oavis  and  Restle,  page  104). 

The  authors  then  go  on  to  discuss  the  hierarchical  and  equalitarian  models 
of  group  problem  solving.  Essentially  the  hierarchical  models  suggest  that 
able  and  efficient  subj  eta  will  dominate  the  group  and  the  less-efficient  mem¬ 
bers  will  be  excluded  from  effective  participation  in  the  solution  of  the  problem. 
However,  the  equalitarian  model  suggests  that  all  group  members  contribute 
about  the  same  amount  of  talk  though  some  are  not  actuaLy  contributing  to  the 
solution. 

In  their  experiment,  Restle  and  Davis  presented  three  different  problems 
to  groups  and  individuals  at  Michigan  State  University.  They  report  that  in  a 
direct  comparison,  group  problem  was  found  to  be  clearly  superior  to  individual 
problem  solving.  In  analyzing  the  data  from  their  experiment,  the  authors 
stated:  "The  data  in  the  equalitarian  model  Indicate  that  in  terms  of  man-hours 
it  is  cheaper  to  have  individual  problems  solved  separately  than  to  use  groups. 
Individuals  in  separate  rooms  will,  on  the  average,  solve  a  problem  sooner  than 
the  same  four  individuals  in  a  face  to  face  group. . . .  though  individuals  will,  on 
the  average,  obtain  a  correct  answer  before  a  group,  they  may  also  obtain 
some  wrong  answers.  Working  separately,  four  individuals  would  not  sepa¬ 
rate  the  cor  .wet  from  the  wrong  answers. . . .  In  this  sense  the  group  is  slower 
but  surer."  (page  115)  At  this  point  in  the  study,  die  authors  caution  that  this 
sort  of  theory  applies  only  when  one  is  searching  for  unique,  correct  answers 
to  problems.  They  indicate  that  the  answering  of  human  relation  type  problems 
where  a  multiplicity  of  possible  answer*  might  be  formulated  may  be  very 
different. 

The  authors  go  on  to  say  ", .  .Within  the  context  of  this  study,  any  asser¬ 
tions  that  inter-member  interaction  results  in  s  'superpool log'  effect  or  the 
assertion  that  group  problem  solving  derives  from  s  simple  pooling  effect  are 
both  seriously  in  question. "  (page  116).  Following  this  line  of  reasoning,  it 
would  then  appear  that  the  real  advantage  possessed  by  a  group  is  in  the  check¬ 
ing  of  possible  divergency  of  viewpoint  which  would  result  m  more  careful 
evaluation  of  potentially  oorrect  alternative*  rather  than  in  the  generation  of 
these  alternatives.  In  conclusion  the  authors  state,  "Social  psychological  data 
in  this  study  agree  quite  well  with  the  supposition  that  groups  were  organized 
in  an  equalitarian  structure.  The  success  of  the  equalitarian  model  suggests 
that  members  who  are  on  the  wrong  track  contribute  their  share  to  the 
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discussions.  The  data  on  choice  of  future  partners  failed  to  reveal  any 
noticeable  trace  of  stable  leadership  within  groups. "  (pp.  116-117) 

Considering  still  another  factor  in  cooperative  problem  solving,  it  was 
hypothesized  by  Smelser(®)  that  subjects  would  perform  best  in  a  cooperative 
problem  solving  task  having  a  dominant  and  a  submissive  role  if  they  were 
assigned  to  their  tasks  with  respect  to  their  scores  on  a  dominance- submis¬ 
siveness  test.  Staielser  administered  a  short  form  of  Gough's  California 
Psychological  Inventory  (CPI)  which  contains  a  dominance  scale  to  categorize 
his  748  subjects.  The  experimenter  selected  subjects  from  the  extremes  of 
the  distribution  on  this  test  and  made  up  various  two- person  groups  from  the 
total  grouping  of  subjects. 

The  experimental  task  devised  for  this  test  involved  the  manipulation  of 
model  railroad  trains.  It  was  the  task  of  the  subjects  to  ^mp'ete  as  many 
mutually  complete  trips  as  possible  around  a  circular  track  with  several  sidings 
in  a  three  minute  period.  The  results  reported  by  the  author  include  the  follow¬ 
ing  interesting  information.  "The  most  productive  group  was  composed  of  pairs 
in  which  the  dominant  subject  was  assigned  the  dominant  role,  and  the  submis¬ 
sive  partner  the  submissive  role.  The  least  productive  group  was  composed 
of  these  pairings  with  the  roles  reversed.  Paired  dominant  subjects  were  more 
successful  than  paired  submissive  subjects  and  both  of  those  pairings  achieved 
more  when  assigned  roles.  All  groups  shows  significant  increases  in  per¬ 
formance  across  trials. . .  "It  was  oonc haded  that  oongruanoe  of  role  and  habitual 
pattern  within  the  subject  and  oompll  moots rity  of  patterns  as  between  subject 
were  major  determining  variables  in  ooopsrative  achievement. "  (page  541) 

This  appears  to  bs  still  anothsr  important  factor  in  tbs  performance  of 
problem  solving  involving  groups  of  psrsoes.  At  first  look,  those  findings 
would  appear  to  ha  in  divarganoa  with  those  of  Davis  sad  Rootle  which  assart 
that  an  equalitarian  power  structure  appears  to  prevail  in  group  problem  solving 
situations.  However,  it  son  bs  observed  that  there  was  no  need  for  s  dominant 
role  in  the  thought-type  problem  solving  situation  in  which  their  sifojsots  were 
employed.  Therefore  it  would  seem  that  the  congruence  of  poreooallty  traits 
which  result  in  primarily  dominant  or  stfomissive  behavior  booome  important 
factors  in  instituting  group  solving  problems  which  require  a  dominant  or  con¬ 
trolling  force. 

Yet  another  aspect  of  group  problem  solving  was  Investigated  by  L.  Richard 
Hoffman  and  Norman  R.  F.  Malar  of  the  University  of  Michigan.  (*)  Their 
general  interest  was  in  exploring  the  idea  that  groups  composed  of  people  with 
varied  personality  structures  would  be  superior  as  problem  solver  when  com¬ 
pared  with  groups  of  more  homogeneous  composition.  An  excellent  synopsis 
of  iheir  findings  is  presented  in  their  summary:  "A  wider  variety  of  problems 
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was  used  to  test  the  generality  of  Hoffman's  (1959)  earlier  findings  that  groups 
composed  of  people  heterogeneous  with  respect  to  personality  were  superior 
in  solving  problems  to  groups  composed  of  people  with  homogeneous  person¬ 
alities.  Sixteen  Homogeneous  and  twenty-five  heterogeneous  four-person 
groups  were  initially  formed  in  the  laboratory  section  of  an  undergraduate 
course  in  the  psychology  of  human  relations.  Homogeneous  groups  consisted 
of  people  with  high  positive  profile  correlations  among  their  scores  on  Gilvord- 
Zimmerman  Temperament  Survey,  heterogeneous  groups  of  people  with  near  0 
or  negative  correlations.  The  group  members  interacted  weakly  in  case  dis¬ 
cussions,  problem  solving  and  role-playing. 

Five  different  problems  were  used  to  test  the  relative  ability  of  the  two 
types  of  groups,  four  with  some  component  of  quality  and  one  only  involving 
acceptance.  The  subjects  were  also  questioned  about  their  satisfaction  with 
the  solution  and  with  their  influence  over  the  solution  for  each  problem. 

The  following  results  were  obtained: 

1.  Heterogeneous  groups  produced  a  higher  proportion  of  high  quality 
solutions  than  did  homogeneous  groups  to  three  of  the  four  problems 
with  quality  components.  On  the  fourth  problem  there  was  little  dif¬ 
ference  and  both  types  of  groups  produced  poor  solutions  for  the  most 
part. 

2.  Mixed  sex  groups  tended  to  produce  higher  quality  solutions  then  did 
all  male  groups. 

3.  Satisfaction  with  the  problem  solutions  was  about  the  same  in  the 
homogeneous  and  heterogensous  types  of  groups. 

4.  Satisfaction  with  the  solutions  was  shown  to  be  more  strongly  corre¬ 
lated  with  the  member's  satisfaction  with  the  amount  of  influence  he 
had  over  the  solutions,  than  with  the  objective  quality  of  the  solution 
or  with  the  member's  actual  amount  of  influence. 

It  is  suggested  that  solutions  with  high  quality  and  high  acceptance  can  be 
obtained  from  groups  in  which  the  members  have  substantially  different  per¬ 
spectives  on  the  problem  and  in  which  these  differences  are  expressed  and 
used  by  the  group  in  arriving  at  their  final  decision. "  (pp.  406-407) 

Thus  still  another  dimension  seems  to  be  added  to  the  psychology  of  group 
problem  solving.  These  findings  of  Hoffman  and  Maier  would  seem  to  indicate 
that  heterogeneity  and  attitudinal  components  among  groups  members  which 
permit  participation  on  the  part  of  all  members  would  promote  the  generation 
of  high  quality,  highly  satisfying  problem  solutions. 
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We  have  now  looked  at  several  dimensions  of  problem  solving  in  a  social 
context.  The  first  experimental  work,  that  of  Davis  and  Res  tie,  indicated  that 
for  sureness  of  solutions  as  opposed  to  speed  of  solutions,  groups  appear  to  do 
best.  The  work  of  Smelser  indicated  that  in  the  situations  where  dominance  is 
necessitated  in  a  problem  solving  situation,  the  assignments  of  dominant  and 
submissive  roles  is  best  done  such  that  people  are  acting  in  accordance  with 
their  habitual  personality  structure.  Finally,  Hoffman  and  Maier's  work 
suggests  that  heterogeneity  among  problem  solving  groups  promotes  the  gener¬ 
ation  of  high  quality  solutions. 

3.9  NUMMARY 

It  would  seem  that  one  can  state  with  a  reasonable  amount  of  certainty  that 
there  is  some  form  of  preparatory  activity  preceding  the  attempt  of  the  human 
organism  to  solve  a  problem.  Depending  probably  upon  the  complexity  of  tho 
problem  and  the  nature  of  the  stimuli  impinging  upon  the  human,  this  prepara¬ 
tory  activity  may  simply  involve  summoning  up  a  repertory  of  well-worn 
responses  from  the  apperceptive  man  or  it  may  involve  the  drawing  together 
of  a  multitude  of  impinging  stimuli  and  deriving  from  them  a  conception  of  the 
existence  of  a  problem  before  even  the  preliminary  phases  of  problem  solution 
can  begin. 

No  doubt  there  is  during  this  phase,  as  suggested  by  Johnson,  some  sort  of 
goal  acknowledgment  or  goal  setting  activity.  Without  this,  responses  emitted 
by  the  organism  would  have  no  direction.  After  this  phase  is  completed,  once 
again  going  along  with  Johnson's  schema,  trial  responses  are  produced.  It  is 
evident  that  there  is  not  a  hard  and  fast  boundary  between  these  two  stages 
because  continual  feedback  and  oontlnual  modification  at  both  goals  and  responses 
would  appear  to  occur  In  many  types  of  problem  solving. 

Following  the  generation  of  a  particular  trial  solution  for  response  whether 
on  the  verbal,  mental,  or  manipulative  level  there  must  be  some  sort  of  Judg¬ 
mental  proooss  which  assesses  or  analyses  the  adequacy  of  this  response.  If 
this  response  does  not  meet  the  goal  set  in  the  first  portion  of  the  process, 
then  presumably  the  subject  will  run  through  the  process  again. 

As  for  tha  inlluenos  of  social  groupings  on  human  problem  solving  behavior, 
it  would  appear  that  this  behavior  is  different  from  that  gsns rated  by  the  Indi¬ 
vidual  human  organism.  Tbs  characteristics  idsntifisd  in  tbs  experimental 
literature  include  the  fact  that  group  problem  solving  is  surer  but  slower  than 
individual  problem  solving;  that  If  a  situation  demands  a  dominant  person  that 
the  dominant  person  be  so  assigned  In  the  problem  solving  task  and  the  submis¬ 
sive  person  or  persons  likewise  be  assigned  to  roles  congruent  to  their  per¬ 
sonality  structure.  Still  another  vein  in  the  literature  suggests  that  groups 
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composed  of  people  of  heterogeneous  personality  structures  are  most  produc¬ 
tive  ot  meaningful  quality  problem  solutions . 

The  preparatory  activity  preceding  human  problem  solving  is  closely  re¬ 
lated  to  the  retrieval  of  information  (objects  and  rules  of  behavior)  structured 
in  accordance  with  the  current  field  of  interest  or  goal,  This  points  to  the  dis¬ 
cussion  of  information  retrieval  techniques  in  section  7,  as  well  as  to  the 
machine-orianted  problem  solving  described  in  section  2.  The  latter  is  par¬ 
ticularly  relevant  to  the  repetition  of  trial  solutions  with  the  improvement  of 
heuristics  at  each  repetition,  a  process  used  to  improve  the  checker  and  chess 
playing  machines  at  the  conclusion  of  or  during  a  game. 
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4.  CREATIVITY  IN  HUMANS 


4.1  DEFINITION 

In  an  attempt  to  define  the  term  creativity  some  basic  issues  are  dealt 
with: 

1.  Is  there  but  one  kind  of  creativity  or  are  there  many  kinds'* 

2.  Are  the  mechanisms  involved  with  creativity  i  irate  or  ‘earned,  or 
both? 

3.  How  do  the  constructs,  creativity  and  problem  solving,  relate  to  one 
another9 

A.  Kinds  of  Creativity 

MacKinnon  (1962)  sees  two  kinds  of  creativity:  artistic  and  scientific. 

Artistic  Creativity  —  Includes  poets,  novelists,  artists.  The  indi- 
vidual  who  manifests  artistic  creativity  externalizes  something  of 
himself  into  the  public  field. 

Scientific  Creativity  —  The  scientifically  creative  individual  acts  as 
a  mediator  between  externally  defined  needs  and  goals.  He  operates 
on  some  aspect  of  his  environment  in  such  a  manner  as  to  produce  a 
novel  and  appropriate  product,  but  he  adds  little  of  himself  or  of  his 
style  as  a  person  to  the  resultant.  Included  among  the  scientifically 
creative  are  industrial  researchers,  physical  scientists,  engineers. 

The  oppoeite  point  of  view  is  held  by  many  and  is  illustrated  by  Hall  (1962) 
who  says:  "a  distinction  is  sometimes  made  between  the  creative  activity  of 
those  working  in  fine  arts  and  of  those  working  in  science.  Again,  both  of 
these  impractical  pursuits  are  sometimes  said  to  be  creative  while  business 
activity  is  not.  These  are  both  fhlse  dichotomies.  The  same  human  imagina¬ 
tion  and  creativity  occurs  in  all  these  fields.  ’ 

Eric  Fromm  supports  the  latter  position  with  his  "creative  attitude"  con¬ 
cept.  The  creative  attitude  is  characterized  by  inquisitiveness,  avoidanoe  of 
sets,  and  the  courage  to  try  strange  ways  of  doing  things. 

In  either  event,  creativity  is  an  approach  to  solving  problems,  whatever 
the  problem  might  be.  Creativity  is  a  function  of  .nuividual  differences  with 
respect  to  approach  and  the  nature  of  the  problems  Involved. 
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B.  Creativity,  Innate  or  Learned? 

The  ability  to  find  creative  solutions  to  problems  seems  to  be  normally 
distributed.  Individuals  are  able  to  Increase  their  capacity  for  creativity,  but 
only  within  limits.  Some  individuals  appear  to  have  a  higher  potential  for  cre¬ 
ative  solutions,  but  nearly  everyone  can  become  more  creative. 

C.  Creativity  a^d  Problem  Solving 

Man's  day  to  day  existence  might  be  defined  in  terms  of  a  series  of  prob¬ 
lem  solving  situations.  Some  of  the  problems  an  individual  could  be  faced  with 
in  one  day  are:  what  necktie  to  wear;  pleasing  his  wife;  and  discovering  a  new 
beat  resistant  metal  alloy  for  space  vehicles.  Each  one  of  these  problems 
might  be  approached  in  a  creative  manner.  However,  the  more  difficult  the 
problems  become  the  more  creativity  is  a  requisite  for  solution. 

Most  problems  doalt  with  by  the  human  being  are  assumed  to  have  solu¬ 
tions.  Solutions  result  from  the  :r  combination  o.  associative  elements 
which  may  not  be  easily  perceiveo  In  other  words,  a  solution  to  any  problem 
involves  the  mediation  of  associative  elements  into  idoational  contiguity.  The 
more  remote  the  requisite  associative  elements  are,  the  mox*.  creative  an 
individual  needs  to  be  to  draw  them  together.  Sarnoff  Mednick  (1962)  hypothe¬ 
sizes  three  ways  of  attaining  creative  solutions,  which  are  methods  of  bringing 
the  requisite  associative  elements  together: 

1.  Serendipity.  In  this  case  the  requisite  associative  elements  may  be 
evoked  contiguously  by  the  contiguous  environmental  appearance 
(usually  an  accidental  contiguity)  of  stimuli  which  eLcit  these  associ¬ 
ative  elements. 

2.  Similarity.  Requisite  associative  elements  are  evoked  in  cootipdty 
as  a  result  of  their  apparent  similarity. 

3.  Mediation.  The  requisite  associative  elements  are  t  yoked  in  contiguity 
through  the  nediatkm  of  common  elements.  Mediation  is  the  process 
often  referred  to  ns  erantive  thinking. 

The  definition  given  shorn  allows  the  factors  that  will  make  for  individual 
difference*  in  the  probability  of  achieving  creative  solutiur  i  to  be  deduced.  Any 
abilities  or  cha-  acteriatlce  which  serve  to  bring  Otherwise  mutually  remote 
ideas  into  contiguity  will  facilitate  a  creative  solution,  any  abilities  or  charac¬ 
teristics  widen  serve  to  mohibit  remote  ideas  from  contiguous  evocation  will 
inhibit  the  creative  sohitio 
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One  of  the  mechanising  which  is  largely  responsible  for  the  inhibition  of 
creattve  thinking  (mediation)  is  set.  For  one  reason  or  another,  problem 
solving  techniques  become  rather  rigid.  When  a  problem  presents  itself,  the 
average  problem  solver  can  see  only  a  narrow  range  ’  possible  solutions.  The 
unique,  the  original  solution  is  arrived  at  by  only  tho^c.  who  are  capable  of 
going  beyona  the  obvious,  of  wading  through  the  stereoiypas. 

4.2  APPROACHES  TO  THE  STUDY  OF  CREATIVITY 

Some  of  the  questions  which  are  raised  as  one  attempts  to  study  creativity 
ire  as  follows: 

1.  Is  there  a  process  amenable  to  analysis  and  synthesis? 

2.  Should  great  people,  or  creative  people,  people  who  are  judged  to  be 
v  reative,  be  studied  to  analyze  their  modes  of  (.Deration,  their  per¬ 
sonality  traits,  and/or  their  backgrounds? 

'i .  Are  certain  environments  more  conducive  to  creativity,  than  others  ? 

When  Stuart  E.  Golann  (1963)  reviewed  the  literature,  he  identified  four 
mrti,  enu bases  in  the  study  of  creativity.  They  are  products,  process,  meas¬ 
urement,  and  personality. 

A.  Products  as  Criteria 

Tbs  study  of  products  with  respect  to  creativity  involves  viewing  products 
as  criteria  sf  creativity.  This  assumes  that  a  trait  of  creativity  either  unitary 
vr  multi-faceted,  will  be  associated  with  end-products  that  result  from  certa;:» 
types  of  behavior.  Products  are  studied  and  judged  for  croativeness.  The 
term  creative  is  then  applied  to  bobavtor  which  produced  the  end-products 
whioh  were  judged  to  be  creative  products. 

There  are  studies  in  which  the  relationship  between  criteria  variables 
such  as  number  of  publications ,  number  of  patents,  and  judges  of  creativity 
ratings  are  investigated.  These  approaches  are  quantitative  rather  than  quali¬ 
tative,  and  may  in  many  cases  be  inappropriate.  For  example,  some  truly 
creative  persons  may  labor  all  their  lives  on  a  few  extremely  difficult  prob¬ 
lems.  The  quantitative  criteria  of  end-products  then  would  not  reflect  their 
creativity. 
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B.  Process 


Here  the  study  of  creativity  is  accomplished  through  emphasis  upon  tho 
processes  involved  rather  than  the  end-products.  Che  major  difficulty  ‘-ere  is 
that  man  is  studying  himself.  He  must  learn  to  introspect  and  to  be  objective 
when  dealing  with  subjective  materials  if  you  will.  He  must  rely  or  observable 
behavior  and  then  draw  inferences . 

Wallas  (1926)  described  the  stages  of  forming  a  new  thought  as  folio  we: 
preparation,  incubation,  illumination,  and  verification.  Preparation  involves 
gathering  data,  and  building  an  apperceptive  mass  Incubation  involves  testing 
the  brain  in  order  to  rid  oneself  of  all  incorrect  seta.  Illumination  invokes 
inspiration,  insight  or  for  a  course  of  action  to  become  clear  during  this  phase, 
his  fourth  step,  verification,  is  merely  to  behave,  to  do  that  which  o:*e  has 
decided  to  do. 

A  question  to  be  raised  at  this  poinl  is:  la  the  creative  process  systema¬ 
tized,  goal  directed  or  plastic.  One  example  of  the  systematized  or  goal 
directed  type  defines  die  creative  process  in  terms  of  six  atepe. 

1.  Realizing  the  need 

2.  Gathering  information 

3.  Thinking  through 

4.  Imagining  solutions 

6.  Verifying 

6.  Bitting  ideas  to  work 

The  author  of  the  above  nix  steps  stated  that  tbs  difference  between  the 
illuminated  minds  of  genius  and  ordinary  people  is  the  speed  wi*  which  they 
proceed  from  step  one  to  step  six.  This  obviously  Implies  that  everyone  goes 
through  the  same  stepe.  That  was  a  systematized,  goal  directed  view  of  the 
creative  prooess.  An  example  of  a  different  view  le  given  by  Taylor  (1962): 
"Tho  rules  of  logic  and  scientific  method  are  a  pay  -'hological  straight-jacket 
for  creative  thought. "  Examining  over  one  hundred  definitions  of  creativity 
which  occurred  in  the  literature,  Taylor  Identified  five  major  levels  erf  cre¬ 
ativity.  The  are: 

1.  Expressive  creati  ity  which  la  an  independent  expression  where  stalls, 
originality,  and  quality  ay*  unimportant. 
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2.  Productive  creativity.  A  new  level  of  accomplishment  when  skills 
allow  development  of  finished  products . 

3.  Inventive  creativity.  Here  a  flexibility  in  perceiving  new  and  unusual 
relationships  between  previously  separate  parts  occur,  not  new  ideas, 
but  new  uses  of  old  parts. 

4.  Innovative  creativity.  Basic  foundation  principles  are  sufficiently 
understood  so  as  to  allow  improvement  through  modification. 

5.  Emergent ive  creativity.  Here  the  conception  of  an  entirely  new 
principle  at  a  most  fundamental  and  abstract  level  occurs. 

It  appears  to  the  present  author  that  if  man  is  to  understand  creativity, 
the  answer  will  result  finally  in  understanding  the  processes  involved. 

C.  Measurement 

Accordingly  to  authorities,  tests  used  to  measure  croative  abilities  have 
not  changed  much  in  the  last  fifty  years,  but  the  methods  of  analysis  have  be¬ 
come  more  complex.  One  approach  is  the  factor  analysis  approach.  Guilford 
(1902)  says  that  the  lack  of  psychological  knowledge  in  the  area  of  creativity 
may  be  attributable  to  the  inappropriateness  of  the  SR  model,  for  the  study  of 
higher  processes.  So  he  used  the  trait  approach  in  the  study  of  creativity,  and 
used  factor  analysis  to  discover  dependable  traits.  Noting  some  forty-seven 
factors  of  intellect.  Guilford  identified  the  following  factorial  aptitude  traits  to 
be  related  to  creativity:  the  ability  to  see  problems,  fluency  of  thinking,  which 
would  be  word  fluency  and  ideational  fluency,  flexibility  of  thinking,  originality, 
re-definition,  and  elaboration. 

Some  of  Guilford's  tests  require  individuals  to  state  defects  or  deficiencies 
in  common  implement*  or  Institutions;  to  produce  words  containing  a  specified 
letter  or  combination  of  letters;  to  produce  In  a  limited  time  as  many  synonyms 
a*  they  can  from  a  stimulus  word;  to  produce  phrases  or  sentences;  to  name 
objects  with  oertaln  properties,  for  example,  objects  that  are  hard,  white  and 
edible;  cr  give  various  uses  for  a  common  object.  Guilford's  practice  in  scor¬ 
ing  these  fluancy  factors  is  to  emphasise  sheer  quantity  rather  than  quality. 
Once  again,  the  question  Is  raised  as  to  the  appropriateness  of  this  approach. 

Another  measurement  approach  other  than  the  factor  analytic  approach  is 
the  criterion  group  empirical  approach.  The  Welsh  Figure  Preference  Test 
is  a  nonlingual  test  which  is  composed  of  400  India  Ink  drawings  to  which  each 
examinee  must  respond  "like"  or  "don't  like. "  An  empirical  scale  was  devel¬ 
oped  by  comparing  the  likes  and  dislikes  of  37  artists  to  ISO  people  in  general. 
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The  revised  scale  consists  of  30  pictures  which  artists  liked  more  frequency 
than  people  do  in  general  and  30  drawings  which  artists  disliked  more  fre¬ 
quently  than  people  in  general.  The  basic  assumption  here,  of  course,  is  that 
artists  are  creative  and  that  artistic  creativity  is  composed  of  the  stuff  of 
which  all  creativity  is  made,  which  is  an  issue  which  has  been  discussed  above. 
One  would  have  reason  to  question  this  approach.  However,  rank  order  cor¬ 
relations  of  0. 40  and  0. 35  between  scores  of  the  Welsh  Test  and  creative 
writing  instructor's  ratings  and  originality  and  creativity  of  their  students 
were  reported  by  Welsh  Gough  (1961)  reported  that  the  scale  showed  the 
highest  single  correlation  0.41  with  criterion  judgments  of  research  workers 
creativity. 

Other  tests  which  did  not  correlate  well  with  the  criterion  judgments  were 
three  ability  measures,  the  Allport- Vernon  Value  Scales,  56  of  the  57  strait 
vocational  inventory  scales,  Baron's  Originality  Scale,  Baron's  Preference  for 
Complexity  Scale,  and  6  Guilford  Measures. 

Criteria  and  Predictors 

The  criterion  problem  with  respect  to  measurement  of  creativity  is  prob¬ 
ably  the  most  critical  and  yet  least  studied  problem.  Insofar  as  research  ia 
concerned,  some  of  the  techniques  which  have  been  used  to  develop  criteria 
are  as  follows: 

1.  Ore  rail  performance  ratings  by  supervisors 

2.  Creative  rating  by  supervisors 

3.  Quantity  of  patents 

The  criterion  problem  arises  with  tbs  consideration  of  each  sew  pre¬ 
dictor.  Predictors  ean  only  be  as  valid  as  tbs  criteria  which  art  developed. 

At  this  point  is  time  m  most  enoossefsl  method  of  establishing  criteria  for 
creativity  is  ’•ating  jy  experts. 

Predictors 

Some  of  die  techniques  which  are  used  as  predictors  are  as  follows: 

1.  Biographical  information 

2.  Self-rating 

3.  Personality  and  originality  inventories 
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4.  Aptitude  sod  intelligence  measures 

5.  Situational  influences  (parental  attitudes) 

6.  Interest  and  motivation  scales 

7.  Academic  grades 

8.  Ratings  by  others 
D.  Personality 

Another  major  emphasis  within  the  psychological  study  of  creativity  is  the 
study  of  personality.  Specifically,  the  study  of  the  personalities  of  persons 
rated  or  judged  tc  be  creative  persons.  These  studies  appear  to  be  subdivided 
into  two  major  categories:  1)  the  study  of  motivation  in  creative  behavior;  and 
2)  the  study  of  personality  characteristics  of  creative  individuals. 

The  studies  of  motivation  i a  creative  behavior  seemed  to  be  characterized 
by  two  divergent  views.  One  view  is  that  creativity  is  a  property  which 
emerges  and  matures  as  an  individual  attempts  to  realize  his  fullest  potentials 
in  his  interaction  with  his  environment.  Conoepts  that  seem  to  be  related  to 
this  notion  are:  Allport's  functional  atonoray,  Goldstein  and  Rogers'  self- 
actualization,  Mays'  motives  for  creativity.  Individuals  are  creative  because 
it  is  satisfying  to  them  since  they  have  a  need  to  relate  to  the  world  around 
them.  So  they  may  experience  tuomaelves  in  action. 

In  contrast  to  the  more  positive  motivations  referred  to  in  fee  concepts  of 
self-actualizstion,  and  motives  for  creativity,  is  fee  other  point  of  view  in 
which  creativity  is  s  by-product  of  repressed  or  unacceptable  impulses. 

Freud's  sublimation  is  a  esse  in  point.  There  do  not  appear  to  be  any  studies 
in  which  these  two  approaches  were  experimentally  compared.  Perhaps  the 
lack  of  critical  experiments  to  test  thsst  two  theories  is  due  to  the  fact  feat 
the  two  groups  of  theorists  mean  something  different  when  they  speak  of  cre¬ 
ativity.  The  Freudians  seorn  to  discuss  painting  and  writing  wlien  they  deal 
with  creativity,  whereas  the  self-actualizing  group  have  a  more  general  ap¬ 
proach.  Also,  fee  concepts  of  sslf- actualization  and  sublimation,  which  they 
use  to  explain  creative  behavior  are  themselves  constructs  and  difficult  ones 
at  that  to  define. 

In  studies  of  personality  attributes  of  creative  individuals,  the  basic  ap¬ 
proach  employed  is  to  contrast  criterion  groups  on  self-description,  other 
descriptions,  test  performance,  life  history  materials,  and  work  habits.  The 
criterion  groups  are  selected  on  fee  basis  of  ratings  of  creativity,  performance 
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on  Guilford  testa,  scores  on  the  Welsh  Figure  Preference  Test,  and  nomina¬ 
tion  of  individuals  of  outstanding  creativity  by  a  panel  of  experts  in  the<r  field. 

The  relationship  between  self-description  and  degree  of  creativity  has 
been  studied  a  great  deal.  Barron  (1952)  reported  that  subjects  at  the  lower 
extreme  on  the  Welsh  Figure  Preference  Test  described  themselves  as  con¬ 
tented,  gentle,  conservative,  unaffected,  patient  and  peaceable.  The  high 
scorers  characterized  themselves  as  gloomy,  loud,  unstable,  bitter,  cool, 
dissatisfied,  pessimistic,  emotional,  irritable,  and  pleasure- seeking. 

Crutchfield  (1961)  attempted  to  describe  personality  attributes  which  tend 
to  characterize  creative  individuals  m  general.  He  reported  that  in  cognitive 
spheres,  they  are  more  flexible  and  fluent.  Their  perceptions  and  cognitions 
are  unique.  In  approach  to  problems  they  are  intuitive,  emphatic,  perceptu¬ 
ally  open  and  prefer  complexity.  In  emotional,  motivational  spheres,  they 
demonstrate  freedom  from  excessive  control,  achieve  via  independence  rather 
than  conformity,  are  individualistic  and  have  strong,  sustained  intrinsic 
motivation  in  their  field  of  work. 

4. 3  AN  APPROACH  TO  THE  STUDY  OF  CREATIVITY 

A  study  by  MacKinnon  (1962)  is  an  example  of  a  way  of  studying  person¬ 
ality  attributes  by  contrasting  criterion  groups.  When  referring  to  MacKinnon’s 
work,  it  will  be  in  terms  of  only  the  architectural  group.  He  studied  many 
groups  representing  engineering  groups,  scientists,  business  men,  poets, 
artists,  and  different  types,  etc.  However,  for  the  purpose  of  studying  his 
methodology  employed,  we  have  selected  only  the  one. 

MacKinnon  himself  aooeptad  the  notion  that  there  is  a  difference  betwean 
artistic  creativity  and  scientific  creativity.  Consequently,  he  placed  a  great 
deal  of  emphaals  upon  his  architect  group,  feeling  that  they  bridged  the  gap 
between  artistic  creativity  and  ccftauttfle  creativity.  Iha  architect  has  oppor¬ 
tunity  to  express  his  own  inner  states  much  as  poets  and  novelists  do,  as  well 
as  being  s  mediator  bstwsen  externally  dsflnsd  needs  and  goals  in  the  same 
manner  as  industrial  researchers,  physical  scientists  and  engineers  do. 

Ho  chose  s  penal  of  experts,  five  professors  of  architecture,  who  nomi¬ 
nated  forty  highly  creative  architects.  Two  additional  samples  wars  selected 
for  study,  both  of  which  matched  the  highly  o restive  sample  with  respect  to 
age  and  geographic  location  of  practice.  The  first  group  we  will  refer  to 
henceforth  as  Architects  1.  The  first  supplementary  sample,  Architects  2, 
had  at  ieaat  two  yearn  of  work  experience  and  association  with  one  of  the 
originally  nominated  creative  architects.  The  ascend  additional  sample. 
Architects  3 ,  waa  composed  of  architects  who  had  never  worked  with  any  of 
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the  nominated  creatives.  The  mean  rating  for  creativity  for  each  of  the  three 
groups,  the  ratings  having  been  made  on  a  nine  point  scale  \v  six  groups  of 
architects  and  experts  on  architecture,  was  for  Architects  1  --  5. 46;  for 
Architects  2  —  4. 25;  and  for  Architects  o  —  3. 54,  the  difference  in  mean 
ratings  between  each  group  being  statistically  highly  significant. 

All  three  groups  were  exposed  to  the  same  psychological  examinations 
and  interviews.  Traits  which  were  derived  from  the  three  groups  are  listed 
below: 

1.  Architects  1  have  good  opiuions  of  themselves. 

2.  The  self-images  of  the  three  groups  were  different.  A1  described 
themselves  as  inventive,  independent,  individualistic,  enthusiastic 
and  industrious.  A2  and  A3  described  themselves  as  responsible, 
reliable,  sincere,  dependable,  clear-thinking,  tolerant,  and 
understanding. 

3.  There  were  no  relationships  between  creativity  and  intelligence. 

4.  Architects  1  scored  five  to  ten  points  higher  on  each  of  the  following 
MMBI  Scales:  depression,  hysteria,  paranoia,  schizophrenia.  This 
was  interpreted  as  good  intellect,  complexity  and  richness  of  per¬ 
sonality,  general  lack  of  defensiveness,  candor  in  self-description 
rather  than  psychopathology. 

5.  Architects  1  scored  extremely  high  on  the  femininity  scale. 

6.  All  groups  showed  s  clear  preference  for  the  complex  and  the 
asymmetrical. 

7.  The  Myers- Briggs -type  indicator  test  was  used  to  measure  openness 
to  e:<perlenoe.  The  idea  Is  that  whenever  the  mind  is  usod,  either  an 
sot  of  perception  takes  place,  In  which  the  individual  becomes  aware 
of  something;  or  an  act  of  judgment  takes  place,  in  which  a  conclusion 
about  something  la  reached.  Everyone  does  both,  but  most  people 
tend  to  show  a  consistent  preference  for  one  or  the  other  of  these  two 
ways  of  using  the  mind.  Creative  writers,  mathematicians  and 
architects  are  peroeptiva  types,  research  scientists,  the  majority  of 
them  at  least,  are  judging  types. 

The  second  preference  measured  by  the  type  indicator  is  (1)  sense 
perception,  which  is  an  awareness  linked  directly  to  sense  and  possi¬ 
bilities,  and  (2)  intuitive  perception,  or  indirect  perception  of  deeper 
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meanings.  Twenty-five  percent  of  the  general  population  show  pref¬ 
erence  for  intuitive  perception.  Ninety  percent  of  the  creative  writers 
show  preference  for  intuitive  perception.  Ninety-two  percent  of  the 
mathematicians  showed  preference  for  intuitive  perception.  Ninety- 
three  percent  of  the  research  scientists  showed  preference  for  intui¬ 
tive  perception  and  one  hundred  percent  of  the  architects  showed 
preference  of  intuitive  perception. 

8.  On  the  introversion,  extroversion  dimension,  two-thirus  of  all  cre¬ 
ative  groups  score  as  introverts. 

9.  On  the  Strong  vocational  interest  blank  all  creative  subjects  have 
shown  interests  similar  to:  Psychologist,  Author- Journalists, 

Lawyer,  Architect,  Artist,  and  Missionary;  and  interests  unlike: 
Purchasing  Agent,  Office  Man,  Banker,  Farmer,  Carpenter, 
Veterinarian,  Policeman,  and  Mortician. 

10.  On  the  All  port- Vernon- Linsy  Study  of  Values  Scale,  in  which  there 
are  six  basic  values:  theoretical,  economic,  aesthetic,  social, 
political  and  religious;  all  have  as  their  highest  values,  theoretical 
and  aesthetic. 

11.  With  respect  to  the  life  history  studies,  the  following  was  found: 
Parents  showed  extraordinary  respect  for  the  child  and  confidence  in 
his  ability  m  do  what  was  appropriate.  Discipline  was  almost  always 
consistent  and  predictable.  Personal  ethical  codes  wore  emphasised 
rather  than  formal  religious  practices. 

A  summary  description  of  the  creative  person,  especially  of  die  creative 
architect,  as  he  reveals  himself  in  his  profile  on  the  California  Psychological 
Inventory  (Gough,  1967),  reads  as  follows:  "He  is  dominant;  possessed  of 
those  qualities  and  attributes  which  under ly  and  lead  to  the  achievement  of 
social  status;  poised,  spontaneous,  and  aelf- confidant  in  personal  and  social 
interaction;  though  not  of  an  especially  sociable  or  participative  temperament; 
intelligent;  outspoken;  sharp-witted;  demanding;  aggressive;  and  self-centered; 
persuasive  and  verbally  fluent;  setf-ooofidaat  and  self-assured;  and  relatively 
uninhibited  in  expressing  his  worries  and  complaints. " 

"He  is  relatively  free  from  conventional  restraints  and  inhibitions,  not 
preoccupied  with  the  impression  he  makes  on  others,  and  thus  perhaps  capable 
of  great  Independence  and  autonomy  and  relatively  reedy  to  reoognize  and  ad¬ 
mit  self-views  that  are  unusual  and  unconventional. " 
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"He  is  strongly  motivated  to  achieve  in  situations  in  which  independence 
in  thought  and  action  is  called  for  but  unlike  his  less  creative  colleagues  he  is 
less  inclined  to  strive  for  achievement  in  settings  where  conforming  behavior 
is  expected  or  required.  In  efficiency  and  steadiness  of  intellectual  effort, 
however,  he  does  not  differ  from  his  fellow  workers.  Finally,  he  is  definitely 
more  psychologically  minded,  more  flexible  and  possessed  of  more  femininity 
of  interests  than  architects  in  general. " 

4.4  RELATION  TO  FORECASTING 

The  three  ways  described  in  section  4. 1  for  attaining  creative  solutions, 
serendipity,  similarity,  and  mediation,  are  all  based  upon  the  association  of 
elements  which  make  their  appearance  contiguously  in  an  environment  moti¬ 
vated  by  the  problem  to  be  solved.  This  parallels  the  forecasting  process  in 
which  information  is  filtered  from  the  total  data  file  using  the  techniques  of 
accidental  discovery  of  relevant  material,  association  of  closely  related  con¬ 
cepts  and  processes,  and  tracing  paths  into  related  subject  fields  through 
synonymic,  homonymic,  and  generic  relationships.  The  inhibition  of  creative 
thinking  through  conceptual  set,  mentioned  in  section  4. 1  as  a  mechanism 
which  narrows  the  range  of  possible  solutions,  has  its  counterpart  in  the  rigid 
structuring  of  technology  into  rarrow  fields  of  specialization  which  inhibits  the 
prediction  of  developments  resting  upon  interdisciplinary  interaction  and/or 
the  creation  of  a  new  conceptual  specialization.  It  is  important  to  note  that 
these  aspects  of  creativity  and  forecasting  are  directly  related  to  the  associ¬ 
ative  manipulation  of  descriptors  or  index  terms  in  mechanized  information 
retrieval  systems  based  upon  concept  coordination,  aa  discussed  in  section  t‘ 

The  information  retrieval  approach  applies  with  equal  power  to  the  stages 
of  forming  a  new  thought  enumerated  by  Wallas,  as  described  in  sec  tion  4. 2. 
None  of  these  approaches  through  semantic  association  provides  for  a  numer¬ 
ical  measure  of  tho  data.  But  the  linkages  do  allow  for  correlation  and  sta¬ 
tistical  measures,  suoh  as  the  factor  analysis  applied  by  Qui'ford.  It  is  not 
surprising  that  factor  analysis  has  also  been  applied  to  descriptors  in  informa¬ 
tion  retrieval  with  the  intention  of  measuring  joint  conceptual  interrelationships 
The  study  of  human  creativity  strengthens  the  conjecture  that  the  mechanization 
of  forecasting  in,  at  least  to  a  substantial  extent,  the  application  of  principles 
and  techniques  of  information  retriaval. 
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5.  DESCRIPTIVE  TASK  ANALYSIS  Of  TECHNOLOGICAL  j 

FORECASTING  f 

V 

p- 

The  preceding  two  flections  discussed  human  problem  solving  and  ere-  * 

ativity  from  the  vantage  point  of  the  psychologist.  The  discussions  were  based 
upon  extensive  study  of  the  literature,  with  special  emphasis  upon  material 
relevant  to  descriptive  task  analyses  of  problem  solving  and  creativity  which 
contribute  to  better  understanding  of  the  operations  engaged  in  by  intelligence 
analysts.  Although  a  small  amount  of  light  was  shed  on  tie  latter,  it  is  evi¬ 
dent  that  much  more  research  is  needed  to  reach  a  satisfactory  level  of  knowl¬ 
edge  on  this  topic. 

From  the  discussion  of  machine-oriented  problem  solving  in  section  two, 
it  k  clear  that  mechanized  technological  forecasting  in  its  most  general  form 
is  a  formidable  task,  hindered  by  incomplete  information  regarding  relevant 
activities  and  developments,  high  noise  level  introduced  by  irrelevant  informa¬ 
tion,  and  unknown  goals  (breakthroughs)  which  are  not  only  unspecified  but  may 
even  be  rejected  through  skepticism  or  sheer  lack  of  recognition. 

If  progress  is  to  be  made,  it  appears  that  a  more  limited  objective  should 
be  set  as  a  first  milestone.  This  might  consist  of  an  intensive  examination  of 
the  Air  Force  definition  of  forecasting  by  talking  to  Air  Force  analysts  and 
developing  a  system  model  of  the  forecasting  prooess  la  their  environment  in¬ 
cluding  all  aspects  from  acquisition  of  source  data  through  generation  of  fore¬ 
cast.  The  derivation  of  the  model  would  of  necessity  unoovsr  questions  con¬ 
cerning  individual  sieps  in  tbs  forecasting  proosss  and  suggest  specific  re¬ 
search  tasks  to  provide  answers. 

Since  the  study  to  develop  a  forecasting  model  was  bsyond  the  scope  of  the 
current  study,  *  beginning  wan  made  by  preparing  a  oonjectured  model  to  s^rve 
as  a  guide  for  forth*;  study  as  well  as  a  framework  for  the  other  work  on  the 
project.  The  oonjectured  model  Is  Illustrated  la  flow  chart  format  in  Figure  5. 

The  text  which  follows  is  a  highly  abbreviated  explanation  of  the  various 
blocks  in  the  chart. 

1.  The  situation  or  milieu  is  tbs  sum  of  tbs  events  and  situations  com¬ 
prising  the  real  world,  ttnoe  events  are  oontinually  occurring,  the 
situation  is  constantly  changing.  Ws  think  of  the  situation  advancing 
in  discrete  steps  through  1,  2,  3,  . . . ,  N. 
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2.  Many  blocks  in  the  flow  chart  represent  i  filter  (F).  Since  no  human 
being  ever  perceives  the  ail  of  reality  and  since  the  human  can  only 
work  with  information  which  is  perceived,  the  filters  repreeont  the 
total  effects  of  selective  perception,  sensory  limitations,  etc. ,  which 
tend  to  modify  human  perceptions  of  the  real  world. 

3.  The  analyst  makes  a  preliminary  effort  to  organize  those  percepts  of 
the  real  world  situation  remaining  after  the  filtering  process. 

4.  In  the  act  of  structuring  the  information  concerning  situation  N,  cer¬ 
tain  aspects  of  the  information  available  are  seen  to  be  less  important 
than  others.  The  total  information  content  is  again  reduced  by  a  fll- 
tei  ing  process. 

5.  The  structured  information  resulting  from  4  is  entered  into  the  bank. 
The  bank  is  conceived  of  as  the  total  organism  -  nervous  system, 
thoughts,  memories,  aperceptive  mass,  etc.  In  snort,  the  structured 
information  becomes  a  par  of  the  total  analysing  organism. 

6.  Out  of  the  totality  of  experience  and  capabilities  represented  by  the 
bank,  the  analyst  will  oompare  the  new  information  to  existing  con¬ 
scious  ideas,  concepts,  and  information  already  within  the  memory. 

7  -  10.  Blocks  7  and  9  represent  the  alternatives  available  to  the  organism 
as  a  result  of  the  comparison  process.  If  the  information  as  struc¬ 
tured  in  3  is  thought  to  be  unique  it  will  be  reentered  in  the  dynamic 
bank  (10)  with  that  label.  It  foe  information  la  not  considered  unique 
it  may  be  forgotten  (8)  or  wjtored  into  the  bonk  (10)  a*  nonaitque 
information. 

11,  13  and  18.  The  information  entered  in  foe  bank  (10)  can  either  be  re¬ 
organised  and  r— tructernd  (IS)  on  foe  basis  of  foe  comparisons  made 
or  the  information  oaa  precipitate  a  reexamination  of  the  total  situa¬ 
tion  baaed  on  tbs  action  thought  moat  appropriate  by  tbs  analyst.  It 
must  be  emphasised  that  situation  N  la  now  situation  N  ♦  1  because 
time  has  elapsed  durii*  foe  time  foe  preoedlag  steps  took  place. 

13  and  14.  The  reexamination  of  foe  situation  moults  in  a  new  set  of  in¬ 
puts  which  am  than  Altered  (13)  and  identified  as  being  either  con¬ 
firmatory  of  the  inputs  of  situation  N  or  aa  being  different  from  them 
in  some  way. 
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16  -  19.  The  reorganisation  (15)  following  the  second- look  inputs  is 
followed  by  filtering  (16),  entry  into  a  bank  (17)  and  filtering  (18) 
again  as  the  restructured  information  is  drawn  upon  for  supporting 
the  formation  of  concepts  (19).  Having  formed  concepts  as  to  general 
trends  or  implications  of  the  perceptual  inputs,  there  are  two  basic 
paths  through  the  next  phase  of  the  process. 

20  -  26.  One  path  involves  the  use  of  the  concepts  formed  (19)  earlier  as 
a  basis  for  generating  tentative  hypotheses  (21)  about  the  implications 
of  the  data.  Both  the  inputs  and  outputs  of  this  stage  are  filtered 
perceptually  (20,  22,  23). 

24  -  26.  Having  formulated  tentative  hypotheses,  the  analyst  must  begin 
looking  for  means  to  verify  or  reject  the  H.  He  can  look  to  either  the 
outside  world  (24)  or  inside  world  (bank)  (26)  in  order  to  identify 
potential  additional  data  sources  (25).  After  filtering  (30)  the  analyst 
then  selects  (31)  those  sources  having  the  most  promise  of  being  use¬ 
ful  in  validating  the  H's  be  has. 

27  -  28.  The  other  path  from  concept  formation  involves  the  establishment 
of  tentative  criteria  (28)  for  validating  of  the  H.  Block  29  shows  the 
idea  that  at  this  Juncture  tee  analyst  forma  a  criterion  against  which 
the  first  H  will  be  tested. 

Carrying  forward  tee  additional  data  collection  process,  the  selected 
data  sources  (31)  are  further  reduced  by  filtering  and  it  is  then  timo 
for  tee  analyst  to  take  a  look  at  these  sources. 

34  -  38.  This  date  is  gathered  from  either  tee  outside  world  (34)  or  bank 
(38),  filtered  (36,  37)  and  finalfy  collected  (36). 

39.  A  aeries  of  relevanoe  tests  (39)  are  then  applied  to  this  data  both  with 
respect  to  validating  data  and  validating  criteria. 

40  -  42.  The  results  of  these  relevance  teste  are  used  to  classify  data  for 
storage  40.  The  act  of  data  storage  is  portrayed  in  41.  Data  re¬ 
trieval  (42)  for  the  final  structuring  (43)  prior  to  analysis  (44)  and 
Interpretation  (46)  is  then  accomplished. 

48  -  49.  The  tentative  hypothesis  generated  in  block  21  is  then  tested  (46) 
in  relation  to  the  criteria  generated  in  28  and  29  and  the  results  of  the 
analysis  of  the  immediately  preceding  steps.  The  results  of  this  test 
are  teen  portrayed  in  47  and  48.  These  outcomes  are  then  put  in  the 
bank  for  future  use  in  future  steps  in  the  analytic  process. 
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50.  The  analyst,  based  upon  earlier  data  from  the  data  bank,  seeks  to 
single  out  possible  actions  which  could  be  appropriate  in  settling  the 
issues  before  him. 

51.  53,  and  55.  Filters  which  screen  out  various  courses  cf  action 
(things  he  cannot  bring  himself  to  try,  cannot  think  of,  etc. ). 

52.  Behavioral  or  data  possibilities  from  reality  (note  that  "reality"  is 
part  of  the  world  from  which  the  problem  originated).  The  process 
of  using  the  same  world  to  suggest  ideas,  supply  data,  and  provide 
the  criterion  is  somewhat  difficult  to  conceive  and  probably  accounts 
for  much  error  and  poor  progress. 

54.  The  usual  memory  process. 

56.  Analyst  thinks  up  ways  to  tost  validity  of  his  further  data  collections. 

57.  Feasibility  estimates  are  made  to  identity  the  activities  which  would 
result  in  supplemental  data. 

56.  The  alternatives  are  evaluated  and  selected. 

59.  Due  to  nonavailability,  forgetting,  selective  recall  or  other  filtering 
processes,  the  actions  which  actually  get  executed  (60)  are  consider¬ 
ably  reduced. 

61  and  68.  These  lndloete  that  there  are  successive  repetitions  of  the 
dsta  acquisition  and  consideration  processes.  Presumably  these  steps 
would  be  reduced  to  sere  la  cases  involving  insightful  problem  solving 

processes. 

68.  Having  dsta  to  oompare  to  expectations,  the  analyst  can  now  oompare 
to  his  preettobllshsd  criteria.  Regardless  of  bow  this  comparison 
tuns  out  ha  needs  to  go  back  out  to  oompare  to  the  real  world  again. 

It  needs  to  be  noted  that  the  world  changes  with  time  so  s  press tab- 
liahad  criterion  may  no  longer  be  appropriate.  Note  also  that  tbs 
world  is  a  product  of  perception. 

65  and  66.  These  show  the  result  of  the  comparison  and,  In  either  case, 
the  outcome  of  the  comparison  in  64  is  placed  into  memory  in  67  where, 
if  thought  to  be  a  good  load,  one  would  capitalise  on  it,  69,  and  use  it, 
70.  Otherwise,  one  would  forget  it  (68)  though  one  might  also  forgot 
a  good  lead  too.  History  seems  to  have  numerous  examples  wherein 
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good  Ideas  were  lost  because  they  were  not  recognized  as  immediate 
goals  or  even  as  good  ideas . 

is  apparent  that  we  know  least  abort  the  contents  of  boxes  15,  19.  28, 

,  43,  44,  46,  57,  54,  and  69.  These  must  be  better  defined  through 
further  research,  as  discussed  at  the  beginning  of  the  chapter. 
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Selection 


52 


63 


Figure  5.  Conjectured  Chart  of  a  Model  o‘  Technologies l  » orecaf  (Sheet  of  7) 


6.  INFORMATION  SCIENCE  APPLIED  TO  FORECASTING 


Study  of  the  discussions  in  the  preceding  chapters  leads  to  the  conclusion 
that  problem  solving,  creativity,  and  forecasting  have  an  important  element  in 
common.  They  are  all  concerned  primarily  with  information  handling.  Tech¬ 
nological  forecasting  is  in  fact  a  particular  kind  of  information  processing. 

There  is  a  basic  difference  between  information  processing  in  problem 
solving  and  that  in  forecasting.  As  described  in  Chapter  2  (section  2.1)  a 
problem  is  composed  of  a  set  of  initial  objects,  a  set  of  operational  rules,  and 
a  specified  goal  description.  Problem  solving  consists  of  repeatedly  applying 
the  rules  to  the  objects,  with  the  objective  of  reducing  the  distance  to  (and 
eventually  reaching)  the  goal.  In  a  sense,  this  is  a  static  game  which  can  be 
played  over  and  over  again,  with  the  differences  among  games  determined  only 
by  the  paths  taken  between  the  initial  conditions  and  the  achievement  of  the  goal. 

On  the  other  hand,  forecasting  is  a  dynamic  game  in  which  the  goals  them¬ 
selves  are  not  known  in  advance.  Thus,  different  games  based  upon  the  same 
initial  conditions  may  1  %d  to  different  goals,  all  of  which  must  be  accepted  as 
feasible  even  though  they  may  differ  in  credibility.  Moreover,  once  a  goal  has 
been  achieved,  the  previously  unknown  conditions  thereby  discovered  become 
themselves  part  of  the  initial  conditions  for  future  games . 

Technological  forecasting  may  be  likened  to  the  Newton  dynamics  of  physi¬ 
cal  objects,  as  illustrated  schematically  in  Figure  6.1.  The  initial  objects  are 
the  present  stats  and  present  trends  of  technology,  which  may  be  compared  with 
particle  positions  and  velocities  in  a  Newtonian  space.  Many  forces  are  brought 
to  bear  upon  tha  prasent  stats  of  technology,  ranging  from  individual  human 
curiosity  through  material  propensities  of  society  *  jocially  or  politically 
recognised  communal  needs.  These  forces  act  upor*  the  present  state  in  accord¬ 
ance  with  laws  of  change  which  are  at  prasent  only  vaguely  understood  and  are 
certainty  much  more  complicated  than  Newton's  F«ma;  better  understanding 
of  these  lews  of  change  is  an  area  of  research  worthy  of  support  if  the  fore¬ 
casting  process  is  to  be  mechanised  effectively.  The  result  of  the  application 
of  the  laws  of  change  is  a  technology  of  toe  future  which,  when  reached,  be¬ 
comes  the  new  present  state  and  present  trends  of  technology. 

The  schematic  illustration  in  Figure  6.1  may  be  extended  by  analogy  to  the 
dynamics  of  a  gas.  The  molecules  of  the  gas  correspond  to  the  individual  bits 
of  technological  information  currently  known,  molecular  collisions  correspond 
to  association  or  correlation  of  technological  concepts ,  and  chemical  reaction 
uniting  two  or  more  molecule*  into  a  new  supermolecule  corresponds  to  con¬ 
ceptual  association?  i— H<ng  to  an  advanced  novel  superconcept  or  development 
in  technology. 
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From  the  preceding  discussion  it  is  evident  that  a  primary  activity  of  any 
analyst/forecaster  is  the  handling  of  information.  It  follows  that  the  mechani¬ 
zation  of  technological  forecasting  is  heavily  dependent  upon  the  foundations  of 
information  science.  The  balance  of  this  chapter  will  be  devoted  to  a  discus¬ 
sion  of  the  handling  of  information  in  preparation  for  its  use  in  a  mechanized 
technological  forecasting  system. 

6.1  THE  ORGANIZATION  OF  FORECASTING  INFORMATION 

The  ultimate  goal  is  the  retrieval  and  manipulation  of  information  in  sup¬ 
port  of  intelligence  analysis  and  forecasting.  Retrieval  implies  prior  storage 
of  not  only  relevant  information  but  also  control  data  for  selective  access  to 
stored  information.  Manipulation  implies  associating  information  of  different 
kmds  and  from  different  sources  to  relate  existing  forces  to  the  present  state 
of  technology  and  to  apply  the  laws  of  change;  more  specifically,  it  implies 
(1)  filtering  out  all  the  "irrelevant"  information  while  retaining  all  the  "rele¬ 
vant"  information,  (2)  guessing  at  missing  "relevant"  information,  and  (3>  pro¬ 
pounding  a  goal  or  goals  which  the  information  appears  to  support.  Or  con¬ 
versely,  it  implies  conjecturing  a  goal  and  successively  Implementing  different 
associations  of  the  retrieved  information  in  attem.  's  to  prove  or  (preferably) 
disprove  the  conjecture. 

For  forecasting  purposes  It  is  act  enough  to  store  only  technological  Infor¬ 
mal  n  since  this  describes  only  present  state  and  treads.  K  is  necessary  also 
to  store  characterisations  of  people,  organisations,  events,  socio-economic 
and  political  motivations,  etc. ,  to  reconstruct,  diagnose,  or  simply  guess  at 
forces  acting  to  crests  changes,  If  Os  system  is  to  make  tentative  forecasting 
conjectures,  than  the  lews  of  change  and  the  criteria  for  recognising  significant 
devslopmanta  must  also  be  stored. 

It  should  already  be  dear  that  the  amount  of  stored  information  is  enormous. 
An  added  complication  is  that  the  oharaoterisatioe  of  the  information  depends 
upon  the  specific  interests  of  the  eventual  user;  the  alplflcmoe  of  an  item 
varies  with  the  ooajactored  goal,  so  that  its  relevance  depends  upon  the  point  of 
view  of  the  analyst/forecaster.  The  control  data  whiofc  am  used  as  "labels"  or 
"Indlclal  keys'*  or  "index  terms"  or  ' ’descriptors"  for  the  pragmatic  retrieval 
of  information  items,  most  be  oarsfolly  assigned  in  tbs  light  of  an  interdisci¬ 
plinary  and  changing  world  of  tnoknology.  The  use  of  a  single  prsassignad 
hierarchy  of  technological  oonoepts  no  longer  applies  in  ordinary  library 
practices;  it  is  a  fortiori  unacceptable  for  labeling  the  forecaster's  files. 

Technological  information  is  in  fact  no  different  from  knowledge  in  guieral. 
Its  structure  is  a  noopUnar  network  of  oonoepts,  with  each  ooooapt  connected  to 
many  other  oonoepts  through  a  multiplicity  of  association  linkages,  as  ilkis- 
trated  in  Figure  «J2.  Tbs  ooooept  A  has  a  number  of  slightly  different  meanings 
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From  the  preceding  discussion  it  is  evident  that  a  primary  activity  of  any 
analyst/forecaster  is  the  handling  of  information.  It  follows  that  the  mechani¬ 
zation  of  technological  forecasting  is  heavily  dependent  upon  the  foundations  of 
information  science.  The  balance  of  this  chapter  will  be  devoted  to  a  discus¬ 
sion  of  the  handling  of  information  in  preparation  for  its  use  in  a  mechanized 
technological  forecasting  system. 

6.1  THE  ORGANIZATION  OF  FORECASTING  INFORMATION 

The  ultimate  goal  is  the  retrieval  and  manipulation  of  information  in  sup¬ 
port  of  intelligence  analysis  and  forecasting  Retrieval  implies  prior  storage 
of  not  only  relevant  information  but  also  control  data  for  selective  acoess  to 
stored  information.  Manipulation  implies  associating  information  of  different 
kinds  and  from  different  sources  to  relate  existing  forces  to  the  present  state 
of  technology  and  to  apply  the  laws  of  change;  more  specifically,  it  implies 
(1)  filtering  out  all  the  "irrelevant"  information  while  retaining  all  the  "rele¬ 
vant"  information,  (2)  guessing  at  missing  "relevant"  information,  and  (3>  pro¬ 
pounding  a  goal  or  goals  which  the  information  appears  to  support.  Or  con¬ 
versely,  it  implies  conjecturing  a  goal  and  successively  implementing  different 
associations  of  die  retrieved  Information  in  attain.'**  to  prove  or  (preferably) 
disprove  the  conjecture. 

For  forecasting  purposes  it  is  not  anough  to  store  onty  technological  infor¬ 
mal  n  since  this  describe#  only  present  state  and  trends.  It  is  necessary  also 
to  store  characterisations  of  people,  organisations,  events,  socio-economic 
and  political  motivations,  eto. ,  to  reconstruct,  diagnose,  or  simply  guess  at 
forces  acting  to  ores  to  changes,  V  fee  system  ts  to  make  tentative  forecasting 
conjectures,  than  the  laws  of  change  and  fee  criteria  for  recognising  significant 
developments  must  also  be  stored. 

It  should  already  be  dear  feat  fee  amount  of  stored  Information  is  enormous. 
An  added  complication  is  feet  fes  charaotsrlsation  of  Os  Information  depends 
upon  the  specific  interests  of  fes  eventual  near;  fes  eiplflcsnoa  of  an  item 
varies  with  fee  oonjsctursd  goal,  so  feat  its  relevance  depends  upon  fes  point  of 
view  of  the  analyst/forecaeter.  The  control  data  whiofc  are  used  as  "labels"  or 
"lndlclal  keys"  or  "index  terms"  or  ''descriptors"  for  fee  pragmatic  retrieval 
of  information  items,  moat  be  carefully  aaaigned  in  the  light  of  an  interdisci¬ 
plinary  and  changing  world  of  technology.  The  use  of  a  single  preaeaigned 
hierarchy  of  technological  ooooepta  no  longer  applies  in  ordinary  library 
practices;  it  is  a  fortiori  unacceptable  for  labeling  tbs  forecaster's  files. 

Technological  information  is  in  feet  no  different  from  knowledge  in  general. 
Its  structure  la  a  aonplanar  network  of  oonoopts,  wife  each  oonoept  ooaneoted  to 
many  other  concepts  through  a  multiplicity  of  association  linkages,  a a  illus¬ 
trated  in  Figure  6.2.  Tbs  oonoept  A  has  a  number  of  slightly  different  meanings 
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Figure  6. 1.  The  Dynamics  of  Forecasting 


Figure  6. 2.  The  Structure  of  Technological  Information 


which  associate  it  with  near-synonyms  in  three  sets  AB,  AC,  and  AD.  At  die 
same  time,  A  is  generically  related  to  F  and  G  In  tree  structure,  while  B,  C, 
and  D  have  a  conceptual  association  with  £  in  the  FG  tree.  There  ts  nothing  to 
indicate  nor  any  reason  to  expect  any  closer  relationship  between  A  and  E.  The 
following  example  is  taken  from  Roget's  Thesaurus: 

G  -  affections  (Class  VI) 

F  -  personal  affections  (Section  II).  (Sibling  sections  are  -  moral  affec¬ 
tions,  sympathetic  affections,  religious  affections) 

Under  moral  affections  are  many  terms,  including  impropriety,  fxemption, 
contempt,  flattery,  and  punishment  (#972).  Under  punishment  are  a 
number  of  forms  of  punishment  including 

E  -  execution,  which  has  a  relation  to 

D  -  expression  (in  music,  #416) 

C  -  acting  (in  drama,  #699),  and 

B  -  action  (#680). 

B,  C,  and  D  are  all  connected  through  A,  "performance.''  In  this  example,  A 
ia  not  in  the  FG  tree  (Claes  VI):  however,  D  is  in  Class  IH,  Section  IQ;  C  is 
in  Class  IV,  flection  Q;  B  Is  ia  Class  V,  flection  I;  aad  A  is  of  oourso  in  all 

three  Classes. 

Moreover,  the  generic  relationship  between  A  and  F  depends  upon  fee 
analyst's  point  of  view.  For  example,  computer  specialists  rank  automatic 
control  as  a  particular  specialty  within  Information  processing;  oontrol  spe¬ 
cialists  rank  Information  proofing  as  a  particular  specialty  within  automatic 
process  oontrol.  From  fealr  own  specialised  points  of  view,  both  are  correct. 

The  point  to  emphasise  is  that  information  of  itself  ia  amorphous.  It  Is 
the  sclantlat/englnea r  who  provides  fee  structure  to  serve  hie  specialised  needs. 
Moreover,  fee  assigned  structure  colors  hie  point  of  view  by  providing  a  biased 
and  unbalanced  characterisation,  wife  his  area  of  specialisation  at  tbs  oeater 
of  the  technological  universe,  fluoh  a  biased  viewpoint  is  detrimental  both  to 
progress  and  to  forecasting.  Specialty-centered  indexing  of  knowledge  must  be 
continually  guarded  against  if  mechanised  support  of  forecasting  is  to  be 
accomplished. 

With  fell  recognition  of  the  enormity  of  the  task  of  aoqulrlng  aad  storing 
all  the  technological,  oontrol,  and  foroe  data  to  provide  worth  while  support  of 
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forecasting,  it  appears  feasible  to  make  a  substantial  start  through  efficient 
use  of  information  science.  Discussion  of  specific  aspects  of  an  implement* 
tion  procedure  will  now  be  discussed. 

6.2  SPECIFIC  ASPECTS  OF  FORECASTING  INFORMATION 

In  addition  to  the  multiplicity  of  sorts  of  information,  and  the  complexity 
of  the  organization  handling  it,  intelligence  material  includes  numerous  quali¬ 
fiers  or  ancillary  tags,  such  as: 

Security  classification 

Need  to  know 

Precedence  of  handling 

General  roMabilii;  of  source 

Specific  credibility  of  instant  information 

Volatility  with  time  of  instant  information 

Date  acquired  or  received 


Report  routine  with  respect  to  time 
Report  routine  with  respect  to  (referenced)  event 
Requested  report 
Happens tanoe  acquisition 


Initial  material 
Confirming  material 
Conflicting  material 
Updating  material 
Supplementing  material 


Forecasting  probably  requires  repeated  recourse  to  a  file  of  information 
which  is  shared  with  others,  some  of  whom  are  involved  in  minor  but  neces¬ 
sary  tasks  such  as  preparing  current  awareness  digests  for  selective  dis¬ 
semination.  Periodically  the  oentral  file  would  be  purged  or  updated,  while 
ability  would  be  retained  for  the  analysts,  etc.,  to  recover  information  which 
they  had  once  learned  to  recall. 
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Some  other  system  parameters  would  be:  A  large  file  of  interdisciplinary 
information  which  is  occasionally  reoriented  with  respect  to  projects  or  sub¬ 
ject  interests,  »  high  degree  of  detail  needed  for  indicia!  keys  and  output  infor¬ 
mation,  some  means  of  performing  validity  checks  as  material  is  processed, 
methods  of  controlling  and  recording  access  to  classified  material,  and  high 
value  ascribed  to  system  speed  of  response.  Complicated  operating  instruc¬ 
tions  might  be  permitted  since  the  users  would  be  a  closed  set.  A  prime 
objective  of  the  system  would  be  the  shaping  or  confirming  of  speculations. 

Factors  regarding  forecasting,  just  cited,  mitigate  in  favor  of  mechanised 
information  storage  and  retrieval.  But  information  retrieval  is  not  a  "solved" 
art.  Information  U,  subjective  in  nature;  its  assessment  depends  upon  the 
viewer  and  the  occasion.  Purveyors  of  information  are  troublesome;  they  some¬ 
times  omit  details  upon  which  we  would  like  to  base  our  system.  However, 
certain  expedients  have  been  time-tested,  and  these  should  be  useful  to  fore¬ 
casting  systems: 

•  Redundancy  is  assignment  of  index  terms  —  which  may  permit 
uncertainty  as  to  one  element  to  be  clarified  via  others. 

•  Assignment  of  chaining  keys  which  may  appear  to  have  no  value  in 
themselves,  but  which  are  ueeful  in  establishing  relationships. 

Simple  exampkw  of  special  chaining  keys  could  be  times  and  pieces  of 
events;  related  events  might  be  discovered  by  searching  la  temporal  or  special 
neighborhoods  -  sdbjwt,  perhaps,  to  other  specifications.  The  general  idea 
of  chains  is  illustrated  in  Figure  6.3,  in  which  ALGOL,  a  digital  computer  pro¬ 
gramming  language,  oould  be  (1)  the  specialty  of  a  parson,  pi)  the  asms  of 
software  for  listed  equipment,  (S)  involved  in  the  reason  for  existence  of  an 
organisation,  and  (4)  one  aspect  of  an  event. 


Figure  6.3.  Illustrating  a  Chaining  Kay 
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The  figure  illustrates  how  such  multiple  associations  oould  be  traced.  Some 
simplicity  may  be  achieved  by  means  of  the  Multilist  a.  tribute-value  approach 
(e.  g. ,  attribute  EQUIPMENT  -  value  ALGOL).  Specific  tasks  to  which  infor¬ 
mation  retrieval  systems  may  be  addressed  include  the  following: 

(1)  Concept  coordination  -  e.g. ,  locating  persons,  organizations, 
documents,  etc. ,  as  described  by  a  conjunction  or  other  logical 
arrangement  of  indicial  keys. 

(2)  Searches  in  neighborhoods  or  along  strings,  perhaps  starting  from 
some  previously  located  node  or  intersection. 

(3)  Investigation  of  associations,  their  nature  and  degree;  forming  asso¬ 
ciations  at  prescribed  removes. 

Some  emphasis  on  second  and  higher  order  associations  may  be  in  order. 
Ouiliano,  et  al. ,  has  pointed  out  that  near-synonyms  are  sometimes  discovered 
via  second  order  relationships .  (He  gives  a  matrix  manipulation  technique  and 
an  analogue  model  for  investigating  same.)  Two  usages  are  immediately  fore¬ 
seen  for  higher  order  associations: 

(1)  Searching  in  nelghborhooda  -  such  as  requesting  all  items  at  one 
remove  from  a  specific  node  -  or  at  one  remove  subject  to  stated 
restrictions,  etc. 

(2)  Relating  doeuxnanta  to  users,  users  to  organizations,  forces  and 
events  to  subsequent  events;  as  well  as  documents  to  documents,  etc. 

The  chaining  techniques  which  we  suggest  initially  are  those  extending  the 
Qray-Prywss  Multilist  System,  perhaps  with  soma  attention  to  Chsydleur's 
SHIEF. 

Information  storage  and  retrieval  ays  toms  new  have  demonstrable  value  in 
assisting  formulation  and  reformulation  of  search  requests.  We  suggest  that 
simple  extension  of  this  capability  may  also  spark  the  speculative  processes  of 
human  analysts  and  forecasters,  as  well  as  retrieve  correlating  information 
from  a  complicated  file. 

6.3  POTENTIALLY  APPLICABLE  MEASURES 

For  purposes  <  f  exposition,  we  may  regard  measurement  as  being  done 
according  to  the  following  progress  ion: 

(1)  By  naming  the  thing  measured  (a  "thing"  being  the  same  no  matter  who 
views  it). 
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(2)  By  associating  it  with  other  things  (which  Involves  abstracting  a  quality, 
consciously  or  otherwise). 

(3)  By  ranking  the  thing  in  order  along  with  other  things  -  within  the  con¬ 
text  of  a  specified  quality. 

(4)  By  assigning  numbers  vis  units  on  a  scale  for  the  abstracted  quality. 

(5)  By  relating  the  thing  measured  to  a  "law  of  nature''  or  to  empirically 
determined,  repeatable  results. 

But  measurement  of  information  -  as  opposed  to  data  independent  of  con¬ 
text  -  is  difficult.  We  can  name  indicial  elements  such  ss  person  and  organi¬ 
zation  ref  at  rents,  and  even  "subject  headings,"  with  some  hope  oi  agreement 
with  others  with  whom  we  work  closely.  We  can  ascribe  relationships  and 
associations;  in  a  simplest  laae,  we  may  denote  whether  an  item  is  or  is  not  a 
member  of  some  set.  We  can  quality  relationships  so  that  they  will  be  applied 
only  with  respect  to  some  point  of  view.  Ordering  or  ranking  may  be  fairly 
easy  when  done  with  respect  to  continue  of  time  and  space,  and  situuUonally  it 
may  be  easy  to  establish  Hierarchies  of  inclusion,  etc.  Our  addition  in 
assigning  numbers  and  in  discovering  "laws  of  nature"  or  of  logic  need  not  be 
utterly  discouraging;  consider  tor  exsmpls  PERT-chartlng,  which  permits 
simulation  and  examination  of  oonseqnsnoes  of  failures  of  projected  actP  '.ties 
or  events. 

Conventional  measure,  using  numbers,  era  be  invoked  profitably  at  this 
time  in  establishing  s  'tlstic*  of  ooourrsnosa,  and  of  oo-ocourrences,  to  the 
end  that  subsequent  discovery  of  similar  patterns  can  cue  investigations  aa  to 
possiblt  repetition  of  previously  observed  results. 

However,  for  the  present,  human  judgment  is  considered  necessary  in 
determining  whether  a  major  advance  or  break&rough  has  occurred,  or  is 
forecast.  A  mechanised  system  oould  nevertheless  provide  alerting  signals  — 
possibly  baaed  on  t.rtluattons  such  as  the  following: 

*  New  trends  in  plotted  curves. 

*  Norms  exoeeded  (s.  g. ,  belloopter  rotor  blades  svosedtng  tbs  speed 
of  sound). 

*  Projected  time  schedules  out  of  limits. 

*  Dependent  or  supporting  organisations  activated  or  dosed. 

*  New  priorities  assigned. 

*  Contracts  or  projects  initiated  or  canceled. 

*  Other  new  forces  applied. 
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Extreme  changes  could  signify  breakthroughs.  Confirmation  might  be  bad 
through  recourse  to  a  "freakish  or  implausible  indications"  file. 

We  suspect  that  maintenance  of  such  a  "freak  file,"  access  to  which  would 
be  available  to  the  various  analysts  and  forecasters,  could  result  in  more  fre¬ 
quent  or  confident  estimates  and  forecasts.  Therefore,  we  suggest  that  char¬ 
acterizations  of  items  of  the  various  sorts  of  information  filed  be  tagged  — 
to  indicate  items  involving  unusually  high,  or  low,  standards  of  excellence 
and/or  high  degree  of  aberration.  For  example,  utilization  of  a  low  quality 
component  in  an  overall  precise  assembly  mi^it  indicate  either  improved 
redundancy  techniques  (i.e. ,  obtaining  high  performance  witn  unreliable  com¬ 
ponents)  or  dev  tlopment  of,  say,  non-linear  control  so  that  previously  impor¬ 
tant  quality  factors  are  diminished. 

Cur  central  thought  in  this  section  is  that  speculation  is  best  conducted  hv 
the  human  brain,  but  that  intelligence  forecasts  incur  a  high  demand  for  sup- 
pc  rting  data  and  information. 

.4  GEI’EItAL  NOTES  ON  INDICIAL  KEYS 

In  the  following  section,  potentially  useful  indicisl  keys  are  listed  of  the 
loll  owing  sorts: 

Documents 

Persons 

Organizations 

Equipment 

Forces 

"Lews"  of  Chsags 

Events 

Times 

Pisces 

These  ere  rough-cut  at  present,  sad  are  presented  chiefly  to  illustrate  the 
ideas  of  Indexing  multiplicity  of  types  of  information,  and  of  providing  chains 
via  many  types  of  connections.  The  scheme  is  generally  the  same  as  that 
which  we  have  been  considering  in  connection  with  the  document  retrieval 
system  (the  ACM  Repository)  which  is  located  at  The  Moore  School,  and  which 
appears  amenable  to  attribute-value  Multilist  techniques. 
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Under  each  attribute,  provision  would  be  ~iada  for  showing  where  s  value  is 
not  assigned  for  unspecified  reasons  (i.e. ,  the  Inducer  is  "not  saying"  why  tbs 
omission  appears)  versus  cases  where  a  value  ooUd  be  assigned  but  it  would  be 
among  the  set  of  "everything  other  than  those  specified  in  the  authority  list." 

Tale  distinction  arises  due  to  occasional  indeterminacy  or  gaps  in  souroes  of 
information. 

For  each  indicia.1  key,  ancillary  tags  could  be  used  to  signal  where  ampli¬ 
fying  or  expository  remarks  are  available  upon  demand. 

Each  indexed  item  could  be  tagged  according  to  its  "freakishness." 

As  a  major  point,  indexed  terms  -  be  they  documents,  persons,  organisa¬ 
tions,  or  whatever  -  would  be  numbered  and  then  chained  with  aa  many  other 
documents,  persons,  etc.  as  reasonable;  this  chaining  might  be  via  times  sad 
places  even  where  thes  appear  to  be  of  no  significance. 

Chaining  connections  conceivably  could  be  tagged  as  follows,  although 
techniques  capitalising  on  this  have  been  poorly  explored  as  yew 

•  Directed  versus  undirected  (L.  e. ,  "arrowhssded"). 

•  Sequence  material  versus  aeqnanoa  immaterial. 

•  Inclusion  indicatad/aot  bv  "axrowhenda". 

e  Connected  items  are/are  not  ayaoayaaio  (nhjsot  or  not  aubjeot  to 
qualification). 

•  Connected  items  are/are  not  aatnaymlo  (aahjeot  or  not  aubjeot  to 
qualification). 

•  Commoted  It  sms  are/are  not  tnopoolflohfy  minted  -  aa  whan  they  am 
Juat  members  of  tho  name,  anordamd  sat. 

0  J  POTENTIAL  CLAflflnCATlOIIS  FOR  FORECASTING  INFORMATION 

ITEMS 

001.1  Aiblisbsd  Teohnioal  Dooumanti 
A  -  General  Nature  of  the  Text 

1-  Advanced  Research  (Decimalism  to  show  whether  (1)  "original  sotartlfic 
paper,"  (2)  "provisional  oommidoation  or  preliminary  notes,"  or 
(3)  "subject  review  article"  in  ; ooordanoe  with  UNE8CO/BC  standards.) 
2  -  For  Subject  Specialists 
3-  Tutorial 
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4-  Survey 

5-  Promotional /advertisement 

6  -  Reference  materifJ/handbook 
7-  Tables 


B  -  Qualifiers  as  to  Authenticity  or  Completeness 

1  -  The  Original 
2-  Copy 

3  -  Mass  Reproduction 
4-  Draft 

•  •  * 

10  -  Abstract 

11  -  Extract 

12  -  Review 


C  -  Professional  Societies  or  Activities  Referred 

1  -  Various,  Not  Indexed  Here 

2  -  Association  for  Computing  Machinery 

3  -  Institute  of  Electrical  and  Electronic  Engineers 


B  -  Type  of  laterast  by  Professional  Society 

1  -  National  or  International 

2-  Regional 

3-  Specialty  within  a  Society 


E  -  Educational  Institution  Rsfsrrsnt 

1-  Various,  Not  Indexed  Hen 

2  -  University  of  Psnnayhrania 

•  •  • 

F  -  Type  of  Output  from  Academic  Institution 

1  -  Doctoral  Dissertation 

2-  Master's  Thesis  (MS) 

3-  Master's  lb  eels  (MA) 

4  -  Research  Report 
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O  -  Private  Research  Foundation  or  Institution  Referrent 


1-  Various,  Not  Indexed  Here 

2-  Institute  for  Advanced  Study,  Princeton 


H  -  Foreign  Work  Described  in  the  Document 

1  -  British 
2-  Canadian 


I  -  (Not  Used) 

J  -  Language  Used  in  Stored  Document 
(Use  same  list  as  H). 

K  -  Military  Activity  Referrent 

1-  Various,  Not  Indexed  Here 

2  -  U.  S.  Department  of  Defense  (Note:  Be  more  specific  if  poesfble). 

3  -  IDA  (Institute  for  Defense  Analysee) 

•  •  • 

8  -  U.  8.  Air  Force. 


L  -  Government  Activity  Referrent  (Non- military) 

1-  Various,  Not  fedsnsd  Bars 

2-  CXflos  of  tbs  President  offeeU.  8. 


M  -  Documentation  Activity  Referrent 

1-  Varloua,  Not  Indexed  Here 
2  -  Library  of  Congress 

3-  DDC  (ex-ASTlA) 


N  -  Physical  Type  of  L„oument 

1-  Bound  Book 
2  -  Journal/ periodical 
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6-  Microfilm  Roll 


O  -  (Not  Used) 

P  -  Physical  Condition  of  Document 
1  -  Good 

2-  Legibility  Marginal:  Fading,  etc. 

Q  -  Type  of  Cover/Container  of  Document 

1-  No  Cover 

R  -  Color  of  Cover/Container 

1  -  Extreme  Mixture 

2-  Blue/ Purple 

•  *  • 

S  -  Special  Contents  of  Document 

1-  Abstract 

•  •  • 

4-  Photographs 

•  •  • 

T  -  Manufacturer  or  Private  Company  Referrent 

•  •  • 

U  -  Machinery  (Hardware)  Referrent 

•  •  • 

V  -  Software  Referrent 

W  -  Other  Versions  of  This  Document  Which  are  in  Stored  File 
(Use  ‘accession  number  of  other  version). 
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X  -  Number  of  Copies  Held 


Y  -  (Special  Indicators  Used  in  Conjunction  with  Z-Code) 


Z  -  Special  Code  (used  to  connect  with  identifying  numbers  in  the  document, 
contract  or  project  numbers,  sponsors  of  work  described  or  of  the  docu¬ 
ment  itself,  etc. ) 

Note:  Covered  by  other  means  are: 

e  Conventional  Bibliographic  Elements  (e.g. ,  authors,  tide,  issuing 
agency /publishet ,  date  of  issue,  number  of  pages,  number  of 
figures .  .  .). 

e  Freely  assigned  descriptors  and  inde ;  terms. 

Storage  and  control  is  via  accession  numbers. 


6.5.2  Persons 


A  -  Theo rists/liethodologiste/Practiti oners/ Poll tioians/Social  *  Entertainers/ 
Workers  /  \ 

/  \  ' 

White  Collar 

Blue  Collar 


B  -  Attachment  to  OrpuUsatlona  ^ClaM  (e.g. ,  U.  ft.  Navy) 

\fjpeolfic  (e.g. ,  Bureau  of  Naval  Weapons) 


C-  Attachment  to  Disciplines 
D  -  Generalised  Function 


(e.g.,  high 


nuclear  physicist) 


Seller  or  provider 
Buyer  or  acquirer 
Custodian 

With  minimised  oontacts 


E  -  Education 


Level 

Specialty 


F  -  Training/ Special  Skills 


71 


o  -  Language  Abilities  Spoken 

\JVritten 

H  -  Nationality  ^ — "Of  origin 

\.  Of  prevlojui  timea 
\pf  the  present 


f  m 


Security  Clearanoe 


^^Level 
N^Need  to 


know 

■N 

J  -  Age 
K  -  Sex 

L  -  Physical  Attributes 
M  -  Health 

N  -  Indications  as  to  Level  of  Performance 
O  -  Avocations 

P  -  Indications  of  Aberrations  or  Peculiarities 
Q  -  Continuing  Chains  to  Parsons,  Equipment,  Etc.  (by  classes) 
H  -  Chains  to  fl^eoiflc  Items. 

Note:  Classify  selected  individuals  as  well  as  groups  in  batches. 
*.8.3  Organisations 

A  -  Qsnsral  Class  or  Mission  r - Governmental 

Military 
Research 
Educations^ 

Commercial 

B  -  Products  <^Tlardware 
\?oftwars 

C  -  Facilities  Occupied 

D  -  Equipment  Utilised 
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E  -  Types  and  Numbers  of  Employees 
F  -  Locations  Occupied  (Geographic) 
G  -  Nations  with  which  associated 


H  -  Capitalization 
I  -  Relationship  to  Other  Organizations 
J  -  Continuing  Chains  (by  classes) 

K  -  Chains  to  Specific  Rems 
6.5.4  Equipment 


Vends  to _ 

Receives  from _ 

Warehouses  for _ 

Distributes  to/for. 


Organizations  to  which  senior 
Organizations  to  which  junior 
Organizations  with  which  affiliated 
Organizations  loosely  related 


A  -  Hardware/Software 

B  -  Producer:  General  Class/Specific  Named  Organization 

C  -  User:  General  Claaa/Speolfic  Named  Organ! nation 

D  -  Ware  bo  user:  General  Claas/Speclfic  Named  Organisation 

E  -  Distributor:  Gaoeral  Class/Skmeifie  Named  Organization 

F  -  Definitions  r-^lletsrtal  of  which  mads 
\  Prooeaa  by  which  built 

\  Formal  daaoription  at  structure  (s.g. ,  geometric  faeturas) 
\Eed-Use  to  which  applied 

G  -  Environment  in  which  Uaefal/aot  usable 

H  -  Cost/Weight/ Stie 

I  •  External  Power  Required 

J  -  Mobility:  portable,  transportable,  fined,  etc. 

K  -  Subassembly  of _ /Major  Assembly  of  _  /Software  (or  Hardware) 

Related _ 

L  -  Continuing  Chains 
M  -  Chains  to  Specific  Items 
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6.5.5  Forces 


A  -  Assigned  Priority  which  organizations 

^v^By  which  persons 

B  -  Natural  Priority 
C  -  Contracts  or  projects 
D  -  Funds  Allocated 
E  -  Facilities  Allocated 


F  -  Organizations  Allocated 


G  -  Persons  Allocated 


By  names 
By  groups 


H  -  Equipment  Allocated 


I  -  "Laws"  of  Change  Related 

J  -  Continuing  Chains 

K  -  Chains  to  Specific  Items 

6.5.6  "Laws"  or  Rules  of  Change 

A  -  Disc  rate/  Continuous 

B  -  ProbabilisUc/Deterministlc/fadeterminate 

C  -  Moootonic/Non-monommc 

D  -  Slngle-v slued/ kfultl -ralued  (discrete)/Zonal 


E  -  Acoelerating/Deceleratlng 
F  -  Relation  to  Referenced  Schedule 

G  -  Continuing  Chains 
H  -  Chains  to  Specific  Items 


Ahead 
Behind 
In  acoord 
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6.5.7  Events 


A  -  Time 

B  -  Place 


At  start 
Duration 


C  -  Sponsor 

D  -  Purpose  r'ro  discover 
\  To  teach 

\  To  influence  or  persuade 
\To  entertain,  for  social  pleasure 


E  -  Likelihood  of  Occurrence 


F  -  Persons  Participating 

G  -  Organizations  Participating 


Names 
P« 


name 

lasses 


H  -  Forces  Related 


I  -  Facilities  Utilised 
J  -  Continuing  Chains 
K  -  Chains  to  Specific  Hams 
L  -  Areas  of  Impact 


Science,  Military.  Socio-political 
oooomlc,  National,  Mlaraational 


6.8.8  Times 
A  -  Local  (date-time) 


B  -  General  Reference  (each  as  Greenwich  date-time) 
C  -  Day/night 


D  -  Season 


E  -  Weather 
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mm 

f 

* 


F  -  Continuing  Chains 
G  -  Chains  to  Specific  items 
S.&.9  Places 
A  -  Name  of  Place 

B  -  Location  on  World  Grid  (coordinates) 
C  -  Organization 


D  -  Nation(s) 


date  established 
date  terminated 


E  -  Continuing  Chains 


F  -  Chains  to  Specific  Items 
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7.  A  MATHEMATICAL  MOO  El  FOR  TECHNOLOGICAL  PREDICTION 


As  has  been  discussed  in  the  previous  sections,  the  general  problem  of 
forecasting  technological  breakthroughs  is  complicated  by  incomplete  knowl¬ 
edge  of  the  present  state  of  technology,  incomplete  knowledge  of  the  forces 
acting  to  change  knowledge,  and  incomplete  knowledge  of  the  l&ws  of  tech¬ 
nological  change  in  response  to  the  applied  forces.  In  this  section,  mathe¬ 
matical  model  is  derived  which  defines  technological  change  in  terms  of  change 
of  present  state  and  presents  statistical  correlation  procedures  for  minimizing 
or  at  least  reducing  the  uncertainties  introduced  by  incomplete  information. 

1>.e  itu  iel  bypasses  the  other  complications  of  generaliz'  1  forecasting,  namely 
the  unspecified  indeterminate  multiplicity  of  goals,  by  specifying  a  particular 
goal. 

The  model  addresses  itself  to  the  prediction  of  advances  to  be  anticipated 
in  specific  aspects  of  a  particular  technological  specialty.  As  stressed  in  the 
preceding  section,  forecasting  is  a  special  case  of  information  manipulation 
and  association.  It  is  therefore  natural  to  find  that  the  model  is  based  upon 
the  descriptor  techniques  of  information  science. 

7.1  PREDICTION  MODEL  PARAMETERS 

Since  the  problem  is  only  chat  of  prediction,  tbs  model  need  not  and  dost 
not  consider  actions  that  might  be  needed  as  a  consequence  of  the  prediction. 
Moreover,  slnoe  the  prediction  is  limited  to  technological  developments,  only 
those  data  which  relate  to  technology  and  its  growth  need  to  be  incorporated 
into  the  Information  file.  There  are  certain  parameters  which  must  now  be 
assumed  within  the  framework  established  shove. 

1.  Tims  must  be  considered  as  an  explicit,  independent  variable.  To 
identify  a  development  after  the  development  has  ooourred  is  not 
prediction  but  merely  Information  retrieval. 

2.  Not  only  the  state  but  also  the  structure  of  technology  is  changing  in 
time.  If  we  define  as  the  'technological  structure"  at  time  t,  we 
recognize  that  the  basic  plan  requiras  acquiring  the  maximum  pos¬ 
sible  knowledge  of  to  achieve  some  (as  yut  undefined)  comprehensive 
knowledge  concerning  the  technological  structure,  ha  addition,  the 
passage  cf  time  (end  the  inherent  advance  in  technical  knowledge) 

will  modify  Sfc  to  Sj+1 .  For  the  area  of  intervut,  %  may  or  may  not 
be  equivalent  to 
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3.  A  key  element  of  prediction  is  the  question  of  what  constitutes  a 
"change."  Technological  development  and  breakthrough  can  be  de¬ 
fined  in  the  following  maimer:  Given  an  information  matrix  St  and 
Sv+i,  separately  derived,  then 

a.  A  new  product-device  "line-item"  appearing  ai  time  t  *  1  should  be 
directly  related  to  one  or  more  research  line-items  at  t.  The 
appearance  of  this  new  line  item  constitutes  a  technological  de¬ 
velopment,  but  not  a  breakthrough. 


b.  A  technological  breakthrough  occurs  when: 


1)  the  set  of  descriptors  at  t  + 1  is  different  from  the  set  at  t, 
and  in  particular: 

2)  the  set  of  descriptors  at  time  t  is  not  sufficient  to  describe 
the  new  line-items,  and  either: 

a)  one  or  more  new  descriptors  must  be  added  without 
violator  i  the  criterion  of  "necessary  and  sufficient" 
implied  in  Step  3  of  the  procedures  for  developing  the 
Information  matrix  (see  section  7.2  below). 

b)  a  new  information  matrix  (m  addition  to  the  existing 
one)  must  be  created. 

4.  A  fourth  parameter  involves  the  degree  of  confidence  and  the  degree 
of  detail  which  must  be  provided  by  the  system  before  one  can  declare 
the  prediction  has  been  successfully  made.  At  the  lower  end  of  the 
scale  is  a  system  which  simply  Indicates  a  change  that  will  occur  with 
a  given  (but  low)  probability  at  some  time  in  the  future,  without  ider.  - 
tiffing  eithei  nature  of  the  change  or  its  Impact  on  observers, 
nils  could  very  easily  be  done  on  tv*  basis  of  a  priori  statistics.  At 
the  extremely  high  cod  of  foe  scale,  one  could  report  with  high  proba¬ 
bility  that  Prof.  Jonas  will,  on  July  18fo,  1966  carry  out  experiments 
which  will  successfully  demonstrate  that  there  la  a  fourth  dimension. 
Clearly  this  could  be  done  only  through  an  extremely  elaborate  intelli¬ 
gence  network,  and  some  god-like  prescience.  The  system  for  which 
we  are  searching  lies  somewhere  between  these  two  extremes;  some 
of  the  changes  from  8^  to  with  high  probability. 
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5. 


A  fifth  and  final  parameter  •'.volvoe  the  value  function  or  payoff  crite¬ 
rion  to  be  used  *o  evaluate  the  degree  of  effectiveness  of  the  problem 
solving  technique  to  be  used.  At  first  glance,  the  value  function  would 
appear  to  be  SLo.  That  is.  the  ultimate  objective  of  the  problem  solving 
system  under  consideration  is  to  effect  a  mapping  of  any  Sj  into  8« 
with  a  minimum  effort  and/or  elapsed  time.  However,  is,  by  its 
very  nature,  undefined  and  we  are  thus  faced  with  the  task  of  evaluating 
whether  is  significantly  nearer  to  S«,  than  In  short,  we  lack 
a  quantitative  value  function.  A  poor  alternative  d  -  y  be  simply  to 
assume  that  more  information,  per  ae,  laid  on  will  lend  to  SL» 

The  above  serve  *o  indicate  that  much  attention  should  be  given  to  the 
definition  of  the  problem  solving  task,  before  further  effort  is  devoted  to  prob¬ 
lem  solving  techniques,  per  se. 

7.2  PROCEDURES  TOR  DEVELOPING  THE  INFORMATION  MATRIX 


As  mentioned  above,  the  model  is  based  upon  the  descriptor  techniques  of 
information  science.  Although  general  information  has  a  network  interrelation¬ 
ship  structure,  specifics i-'  .n  of  the  subject  of  internet  in  the  prediction  (the 
"line-item")  permits  a  protection  of  the  information  network  onto  a  plane  into 
the  structure  of  an  information  matrix.  An  illustrative  matrix  is  shown 
Figure  7. 1;  a  more  general  matrix  is  shown  in  Figure  7. 2.  Justification  lor 
this  s implication  is  Its  sucoesr*\l  application  to  foe  forecasting  of  trends  in  a 
number  of  technological  areas;  an  actual  example  la  dcacrlbad  below.  Proce¬ 
dures  for  generating  foe  matrix  art  ae  follows: 

Stop  1.  At  any  time  t,  gather  all  data/ information  on  a  subject  arcs  of  Interest. 
The  area  moat  contain  one  or  mom  product-device  "line- items." 

Step  2.  Evaluate  foie  data  baas  and  itlsutlfr  product-device  "liuc-iteme."  For 
example,  for  foe  computer  subject  field,  a  Uaa  item  might  be  the 
"TOM  Computer." 

Step  3.  Consider  foe  set  of  "fins'  limns"  and  develop  a  list  of  descriptors 

which  categorise  these  liae-iteoas.  The  number  of  descriptors  must 
be  suffiolmt  to  difienutiate  between  each  line-item,  yet  must  not  be 
greater  than  foe  minimum  number  to  litwittfr  all  items  without 
redundancy. 

Step  4.  Set  up  a  matrix  of  line-items  versus  descriptors  and  fill  hi  with 
known  data  as  of  time  tq. 


70 


Step  5.  Identify  all  research  under  way  which  may  affect  one  or  more  of  the 
above  descriptors.  Call  each  research  project  or  project  class  a 
research  "line-item." 

Step  6.  Evaluate  each  research  line-item  relative  to  the  set  of  descriptors 
and  establish  (tor  every  relevant  intersection),  the  impact  of  that 
research  or.  that  descriptor,  and  the  estimated  time  of  any  break¬ 
through^)  which  are  projected  to  occur.  Impact  will  be  described 
in  terms  of  a  linear  scale  from  0  to  1. 0. 

Step  7„  Add  all  research  "line-items"  to  matrix. 

This  process  is  repeated  for  each  matrix  at  every  new  time  period,  until 
production  data  and  comparison  tables ,  and  cross-correlation  factors  have 
been  built  up,  such  that  each  new  matrix  can  be  automatically  predicted  in 
advance. 

7.3  TYPICAL  DESCRIPTORS  FOR  A  SPECIFIC  FORECASTING  EXAMPLE 
D|  General 

1. 1  Cost  of  the  basic  system;  purchase  price  in  dollars  of  a  minim' m  work- 
atHs  6>atallatio(u  composed  of  commonly  used  input  and  output,  minimum 
logic  «nd  control  and  storage,  internal  working. 

1.2  Coat  of  avaraga  system;  the  purchase  prioe  In  dollars  of  an  average  of 

actual  at  time  If  such  Is  available.  If  not  available  an 

estimate  should  be  developed  based  on  tee  usage  of  similar  systems  at 
the  time. 

1.2  1.4  Monthly  rental  (ter  items  1  and  2  respectively). 

1.6  teitlal  teetallattee;  the  date  tee  first  system  was  delivered  to  the 
customer. " 


D„  fystem  Technology 

2. 1  Logie  type;  tee  type  of  hardware  elements)  used  in  logical  circuits, 
s. g. ,  Magnetic  Cores,  Transistors,  Diodes 

2.2  Ability  to  add  modules. 


80 


J>3  Processing 

3. 1  Basic  Rdae  Repetition  Rate  (in  megacycles  per  second). 

3.2  Timing;  synchronous  or  asynchronous. 

3.3  Operation;  sequential  or  parallel. 

3. 4  Number  of  addresses  per  instruction. 

3.5  Number  of  index  registers. 

3. 6  Binary  word  size  (number  of  bits). 

3. 7  Decimal  word  size  (number  of  digits). 

3. 8  Alphanumeric  word  size  (number  of  characters). 

3.9  Add  time  —  (Microseconds,  excluding  access). 

3. 10  Add  time  —  (Microseoonds,  inohxfii^  access). 

3. 11  Multiply  time  —  Microseconds  (exeludiaf  access). 

3. 12  Multiply  time  —  Microseoonds  (toelading  access). 

3.13  afrccial  features  (specif). 

D4  Storage 

For  each  type  of  storage; 

4.1  Erisfion  to  Ootoyfir 

totoraal;  storags  fceflttiee  fuming  an  Integral  physical  part  of  the  oosa- 
putsraad  directly  oontroOed  by  the  oontpntor;  the  total  storags  aatosast- 
icaUy  access  ibis  to  the  oompator. 

Secondary;  storags  feollittec  not  an  Integral  part  of  the  computer  but 
director  connected  to  and  ooatroUsd  by  the  computer 

External;  storage  facilities  diroroed  from  the  computer  Itself  but  bold¬ 
ing  informsticn  in  the  form  prescribed  for  the  oompator. 
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Buffer  a  tor  age;  a  synchronizing  element  between  two  different  forma  of 
storage,  usually  between  internal  and  external. 

4.2  Media,  delay  line,  CRT,  drum,  tape,  core. 

4.3  Characteristics 

Average  access  time;  the  time  interval  in  microseconds  between  the 
instant  °t  which  information  is  called  from  storage  and  the  instant  at 
which  delivery  is  completed,  or  ready  for  storage  and  the  instant  at 
which  storage  is  completed. 

Transfer  Rate;  the  number  of  units  of  information  per  second  that  can 
be  read  or  written,  at  the  maximum  rate. 

Capacity,  (minimum  or  basic);  number  of  units  of  information  that  the 
basic  system  is  equipped  with  or  the  minimum  number  of  units  that  can 
be  obtained. 

Capacity,  (maximum);  maximum  number  of  units  of  information  that 
tKe  system  is  capable  of  using. 

Dg  Input 

S.  1  Maximum  number  of  inputs  to  basic  or  minimum  system  allowing  kcmp 
output. 

g.  2  number  of  inputs  to  maximum  system  allowing  some  output 


6.3  For  each  type  of  input  possible;  maximum  number  of  this  type  possible, 
maximum  rafts,  apodal  features. 


6. 1  T>ps;  off-linn,  on-linn,  land-line. 

6.3  Channels;  (number) 

6.3  Rate;  bita/seoood,  decimal  dlglts/seoood,  characters/second. 

D7  Output 

7. 1  Maximum  number  of  outputs  of  basic  or  minimum  system  allowing  some 
input. 
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7.2 


Maximum  number  of  outputs  of  maximum  system  allowing  some  input. 


7.3  For  each  type  of  output  possible;  maximum  number  of  this  type  possible, 
maximum  rate,  special  features. 

Dg  Physical 

8. 1  Power  of  the  basic  or  minimum  system  (in  KVA  or  KW). 

8.2  Size  of  the  basic  system  (in  square  feet). 

8.3  Volume  of  the  basic  system  (in  cubic  feet). 

8.4  Weight  of  the  basic  system  (in  pounds). 

8.5  Minimum  and  maximum  operating  temperature  (degrees). 

8. 6  Relative  humidity  range,  upper  and  lower  limits  (percent). 

A  partly  completed  matrix  is  shown  in  Figure  7. 3. 

7.4  FORECASTING  ESTIMATES  FROM  RESEARCH  AREAS 

The  preceding  matrix  displayed  information  on  tbs  current  state  of  tech¬ 
nology.  To  this  must  be  added  the  forcee  anting  to  altar  the  technology.  A 
particular  matrix  appBoafalo  to  tho  specific  example  oonetete  of  relevance 
eetlmatee  for  advances  in  the  arena  at  specific  desorlptore  stemming  front 
research  activttfes  in  known  apart  attlae.  Flgor*  7.4  ittaatrataa  the  relevance 
eetlmatee  for  aeaae  of  the  descriptors  of  Figure  T.  S  and  three  specialties, 
multiple  proeeeeore,  Inter— Hoe  retrieval,  and  andecfeonioa. 

7.8  APPUCATTOM  OF  MATRIX  DATA 

To  apply  the  laformatloa  ham  the  nntrloaa  daaertelng  stats  of  the  art  and 
forces  being  applied,  tee  Inna  of  change  axe  regal  red.  Thane  laws  axe  aaoee- 
aarily  determined  by  tea  apeciflo  tanfendfigy  and  forces}  one  of  tea  goals  of  a 
study  *o  mechanise  forecaatfeg  should  ba  to  olasalfr  tease  lane  Into  olaaaea 
applicable  to  onto  of  technological  apooialtfee  and  typos  of  forooa.  Aoonven- 
tional  approach  la  the  use  of  etralght-Uno  prediction.  This  is  affective  ter 
short  range  forecaatfeg  but  becomes  progressively  leas  accurate  for  kmgor 
range  forecasts. 

Three  examples  of  straight  Uxm  foreoasting  from  the  matrloos  of  Figures 

7.3  and  7.4  are  shown  in  Figure  7.5.  One  observes  that  the  larger  computers 
are  aiming  toward  400  instructions  while  the  small  computers  are  stabilising 
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at  about  40.  There  is  a  continuing  tendency  for  computers  to  be  designed  with 
an  intermediate  number  of  instructions . 

On  the  other  hand,  memory  access  times  for  large  and  small  computers 
seem  to  be  aiming  toward  one  and  ten  microseconds,  respectively,  with  perhaps 
a  group  of  intermediate  computers  having  four  microsecond  access  time. 

Weight  for  all  computers  seems  to  be  headed  for  the  3000  to  5000 
pound  range. 

These  forecasts  have  in  fact  been  borne  out  by  recent  developments  but 
new  forces  have  been  brought  into  play,  such  as  thin  film  memories  and  micro¬ 
electronics,  which  are  affecting  the  accuracy  of  continued  straight-line  pre¬ 
diction.  Moreover,  as  stated  above,  the  illustrative  example  is  simpler  than 
the  general  forecasting  problem  for  several  reasons.  Presumably  the  matrix 
approach  can  be  used  in  the  more  intricate  situations  using  the  foil  information 
network  (as  discussed  in  section  6);  this  can  be  determined  only  by  further 
study  of  the  utilization  of  the  more  general  information  file. 


FlfHT*  7.  1. 
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Figure  7. 5a.  Forecast  of  Number  of  Instruction*  in  a  Computer 


Acccit  Tim*  in  Microseconds 


Figure  7.5b.  Forecast  of  Internal  Storage  Access  Time 
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8.  RESEARCH  IN  PREDICTION  THEORY  THROUGH  GAMING 


One  of  the  purposes  of  this  study  was  to  plan  and  describe  a  program 
aimed  at  developing  methods  which  will  be  useful  in  technological  analysis  and 
prediction.  This  section  formulates  an  experimental  game  for  studying  human 
forecasting  strategies  and  describes  several  tasks  which  would  be  appropriate 
as  components  of  such  a  program. 

8.1  GENERAL  OUTLINE  OF  A  FORECASTING  GAME 


This  section  describes  a  particular  experimental  game  which  can  be  used 
for  obtaining  greater  insight  into  forecasting  strategies  implemented  by 
analysts.  The  game  requires  descriptions  of  a  universe  of  both  technological 
and  supporting  information;  derivation  of  a  model  should  prove  of  itself  to  be  a 
contribution  to  mathematical  modeling  of  the  forecasting  process .  The  actual 
play  should  expose  forecasting  strategies  which  can  be  evaluated  by  statistical 
techniques  Specific  games  and  specific  experiments  for  gaining  insight  into 
the  forecasting  process  should  be  specified  as  results  from  earlier  games  are 
attained. 

The  general  model  will  now  be  described.  The  universe  is  a  process  y(t), 
t  -  0,  1,  2,  . . . ,  where  t  represents  time  and  where  the  process  is  dependent 

on  certain  parameters  Xj . Aa.  At  a  later  stage  it  will  be  desirable  to 

consider  the  At  as  varying  in  time,  but  for  the  present  time  we  coosider  them 
as  fixad.  Wa  assume  an  additive  process  y(t)  ■  fi  Ai,  - .  - ,  A*)  +  . . . 

+  *m  (tf  A|,  . . . ,  An)  +  € .  Note  that  C  is  a  random  variable  subsuming  the 
effects  of  factors  otttst  than  the  fj,  and  that  e  ■  c  (t). 

The  universe  also  contains  certain  other  Emotions  of  the  parameters  At- 
Although  tills  might  well  be  generalised,  we  will  state  each  as  a  function  of  a 
single  parameter: 

—  *  \mLn*n't) 

The  player  is  given  a  set  of  observations  on  y 


and  also  observations  cm  the  functions  L 


L10 . Ll,a-b  ’  ,,,J  Lno . Ln,a-b 
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*  vf.r-vj 


The  object  of  the  game  is  the  "forecasting"  of  ya+1. 

The  game  is  played  as  follows.  The  player  must  pay  $B  to  play  the  game.  The 
player  is  given  the  universe  information  and  a  fixed  sum  of  money,  $C.  He  may 
either  make  his  forecast  of  ya+j  immediately,  or  he  may  purchase  additional 
information  and  then  forecast.  The  additional  information  consists  of  the  data 


X 


3, 

* 


■‘l.a-b+l* 


la 


Ln,a~b+1 . Lna 


We  assume  here  that  the  item  may  be  purchased  at  a  cost  of  $diq  in  a 
sequential  fashion;  other  arrangements  may  be  considered. 

Let  6j_,  &2f  <^3>  ^4  he  positive  quantities  and  let  ya«i  be  the  player's  forecast. 
The  following  payoffs  hold  for  the  stated  intervals: 


Interval 


y 


a+l 


'a+l 


6-6 
1  2 


'a+l 


a+l 


a+l 


a+l 


-  a  - 


-  6. 


+ 


*  V 


6„  S  'y' 


a+l 


<  y. 


a+l 


-  <5. 


a+l 


<  ya+l  + 


s  <  y, 


a+l  *a+l 


*  *» +  4« 


a+l 


Payoff 

xi 

x,  [«y  Xj  x4  x,  x5  Xj] 

x« 

*. 


Information  relevant  to  this  play  is  recorded.  This  includes  the  number 
of  additional  items  purchased,  the  types  of  items  purofaeeed,  the  adverse 
parameter  values,  the  observed  values  y0,  . . . ,  ya;  Ljq,  . . . ,  Lqt  a_t> ;  . . 
Lqo . Ln(a_b,  the  fbreoast  5a+l  >  sad  the  payoff  X  obtained. 

Furthermore,  the  player  will  be  classified  according  to  a  number  of  vari¬ 
ables  such  as  ags,  educational  background,  forecasting  esperlanoa,  etc. 


The  same  person  will  play  the  game  several  tlmas;  each  play  should 
involve  a  parameter  change.  Finally 

(1)  his  overall  performance  will  be  evaluated  in  terms  of  payoff  achieved, 
and 

(2)  an  attempt  will  be  made  to  characterise  hie  strategy  in  terms  of 
various  possible  strategies. 
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Consider  for  example  a  particular  case  of  the  general  game: 


4  parameters  \  ,  A2,  A3»  X4  = 

2  additive  functions 

VW  X2)  -  Aj  +  >2  t 
f  (t  A,»  A.)  *  A _  sin  A.  t 
y(t)  =  Aj  +  A2t  +  A3  sin  A4t  +  €  0 

L1  *  2Xl'  L2  =  1/2  A21,  L3  "  x3  +  *•  L4  =  1/2  x4 


€  -  N(0,16),  a  random  number  betv/een  0  and  16,  inclusive 


Ax  =50,  A2  *  -2,  A3  ■  5,  A4  =  1 

Give  the  player  10  items  y0,  . . . ,  y9.  The  value  y^Q  is  determined  by  (j*) 
above.  Give  tbo  player  also 


Giro  him  $1000  play  money.  Charge  him  $600  to  play  the  game  Make  avail¬ 
able  the  following  information  at  the  cost  shown. 

Item  Cost  to  Player 


Il,8* 

Ll,9 

$  25 

Ll,10 

50 

L  , 

L„  A 

25 

2,8 

2,« 

5C 


25 
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“P~  ■ 


Item 


Coat  to  Player 
$  50 


L3,10 

L4,8*  L4,9 


25 


50 


Let  him  purchase  any  items  he  wishes . 
t  motion  might  be 


*10  *  5  <?10 


V  +  1  <  'y  <  v  +  fi 
*10  *10  *10 


v  -  2  S  v  <v  +1 
*1U  *10  *10 

yio  -  8  S^10  *  yio  -  2 


yio  '  yio  -  8 


Then  he  forecasts  yjo-  The  payoff 

$1,000 

100 

2,000 

500 

200 


Characterise  the  player  and  then  attempt  to  characterise  hie  strategy.  Vary 
parameters  and  repeat. 


To  approach  the  sort  of  games  that  wonld  be  closest  to  the  problem  of 
prediction  of  technical  Innovation,  one  ahoald  first  vary  tbs  parameters  daring 
a  game  antf  tnea  arrange  a  threshold  altaahna  tor  one  of  them. 

RULES  OF  AN  ILLUSTRATIVE  QAlflCt 

1.  Qtran  premises,  alternate  aotlone  are  authorised. 

(a)  all  poeelhle  sets  of  premises  ere  accounted  tor  -  felly 
determinate  game. 

(b)  some  sets  of  premises  are  omitted,  i.e. ,  completely  free 
choice  to  player. 

2.  Premise*  will  occasionally  refer  to  history  during  the  game  as  well 
as  present  circumstances. 
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3.  Rewards  are  given  proportional  to  success  in  second-guessing  what 
the  game- manufacturer  manufactured. 

4.  Purchases  of  additional  information  on  the  universe  can  be  made. 
8.2  SPECIFIC  TASK  DESCRIPTIONS 


The  tasks  are  all  empirical  in  nature.  While  a  very  important  part  of  the 
proposed  program  deals  with  basic  psychological  research  into  human  decision 
processes,  another  segment  uses  modeling  and  gaming  in  an  attempt  to  simu¬ 
late  such  processes  in  environments  of  differing  artificialty.  As  part  of  this 
latter  segment,  the  following  games  are  proposed. 

Task  I:  Preliminary  Game  Simulating  Technological  Change  in  Terms  of 
Parameter  Change. 


The  point  of  view  adopted  is  simply  this.  A  forecasting  system  cm  be 
described  in  terms  of  people,  objects,  and  relationships  between  these.  The 
description  is  thus  a  set  of  relations  involving  m  iny  parameters.  Technological 
change  is  associated  with  parameter  change  and  technological  innovation  and 
breakthrough  with  rapid  parameter  change.  Hence  in  this  first  preliminary 
game,  the  problem  to  be  studied  is  one  of  differences  in  speed  of  recognition  of 
parameter  change  by  a  single  individual  who  has  no  control  over  technological 
developments,  i.e. ,  a  passive  one-party  game.  It  will  be  necessary  to 


I.  a:  Decide  upon  the  ftmotiooal  form  of  the  prooess,  i.  e. ,  choose  y(t), 

V  «V 


It  •  •  •  t 


L^s  in  particular  the  innovation  parameter. 


Lbt  Determine  the  ooet  of  playing  and  the  cost  of  additional  information. 


Los  Determine  what  additional  information  in  to  be  available  and  at  what 
time. 


Ld:  flyeelfr  the  rales  of  play  aad  the  game  format. 

Le:  Decide  what  information  should  be  reoorded  about  the  player  and 
about  hie  play. 

I.  f:  Decide  upon  the  preeoripttvo  decision  models  with  which  the  empiri 
cal  results  are  to  be  compared. 

I.  g:  Play  the  game  aad  compare  results  with  models. 
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If  such  a  one- party  game  is  played  using  many  different  players  with  one 
play  for  each,  several  different  results  should  be  obtainable,  each  of  internet 
within  the  context  of  predicting  technological  change. 

(1)  Based  on  Le.  above,  it  should  be  possible  to  characterize  players  by 
attributes  and  to  correlate  these  with  degree  of  success  in  playing. 
"Degree  of  success"  can  be  measured  by  the  players  bankroll  alter  the 
last  payoff  of  the  game.  Thus,  a  first  step  could  be  taken  towards 
identifying  characteristics  of  individuals  which  are  associated  with 
recognition  of  parameter  change  (in  this  limited  sense)  and  with  adap¬ 
tion  to  the  new  situation. 

(2)  Based  on  Lf.  above,  it  should  be  possible  to  determine  which  individ¬ 
uals  or  sets  of  individuals  tend  to  follow  a  given  prescriptive  model. 

Of  course,  it  is  possible  that  no  person  or  group  will  follow  any  model; 
however,  that  is  an  unlikely  eventuality,  in  our  opinion.  And  as  a  by¬ 
product,  it  should  be  possible  to  compare  the  accuracy  of  prediction  of 
those  groups  using  the  prescriptive  models. 

(3)  Experience  in  predictive  gaming  would  be  alned.  This  would  be  very 
useful  in  implementing  later,  more  oompl  ated  games. 

Task  II:  Breakthrough  Recognition  In  bteUifS  >e  Content. 

In  terms  of  technological  change,  the  mslysts1  lob  oonstets  of  two  parts. 

He  must  first  identify  changes  which  are  in  tbs  making.  Than  he  must  oome  up 
with  s  time  estimate,  i.s.,  an  estimate  of  tbs  time  whan  that  aaad  at  which  the 
change  is  aimed  win  be  satisfied.  Turin  n  aad  TO  attack  the  first  problem. 

Design  a  sequence  of  esparto— is  la  which  sahjsnta  are  prssftl  with  bite 
of  information  relevant  to  the  hkriMttn  of  a  tackanloglos]  innovation  in  an 
observed  system.  After  each  fait  has  bssn  digested,  tea  subject  Is  asked  to 
identify  tbs  ianovation,  if  asy.  &  will  bo  neooosary  to: 

ILa:  8olsot  the  situations  to  bs  shafted.  Decide  between  actual  current 
situations,  actual  historical  situations,  ud  faypothatloal  situations. 

n.b:  Choose  and  organise  tee  informational  input  to  the  svfcjeot. 

H.c:  Decide  upon  tee  aoope  of  tee  subject' a  reference  in  each  situation. 

Q.d:  Choose  the  individual  subjects.  (Probably  some  actual  mafysts 
should  be  brought  Into  tee  picture  at  a  late  stage. ) 


1L  e:  Set  up  a  rating  system  for  comparing  the  performance  of  the  several 
subjects. 

n.  f:  Conduct  the  experiment. 

If  such  a  one-party  gam.  is  played  using  many  different  players  with  one 
play  for  each,  results  should  be  obtainable  similar  to  (1)  above.  Successful 
and  unsuccessful  players  should  be  characterized;  also  information  should  be 
obtained  on  normative  models  which  actually  approximate  human  decision 
behavior.  In  addition  other  valuable  results  should  arise. 

(4)  In  studying  the  form  of  the  input,  results  should  be  obtained  which 
bear  on  desirable  ways  of  organizing  intelligence  data  relative  to  the 
prediction  of  technological  change. 

(5)  In  playing  the  game,  further  evidence  of  effective  systematic  proce¬ 
dures  for  detecting  technological  change  should  be  found. 

Task  PI;  Breakthrough  Recognition  in  a  Competitive  Industrial  Context. 

This  task  repeats  n,  but  now  the  specific  environment  has  shifted  as  indi¬ 
cated  to  an  active  two-party  game,  l.e. ,  a  competitive  game  in  which  two 
players  have  knowledge  of  the  technology,  each  knows  a  few  things  unknown  to 
the  other,  and  each  can  influence  technological  developments  by  causing  certain 
research  or  development  activity  to  take  place.  Steps  a-f  are  identical  for  n 
and  m. 

Task  IV;  Revision  of  Fetor  Probability  Distribution  in  a  Military  Intelli¬ 
gence  Context. 

This  task  and  flw  following  cna  apeak  to  the  aaoond  part  of  the  analysts' 
Job,  namely,  toe  time  eattmate. 

fa  tliia  task  the  subject  is  told  what  innovation  is  in  question.  After  each 
bit  of  information,  he  to  asked  to  estimate  the  probability  distribution  of  the 
time  of  need  satisfaction.  The  study  would  concentrate  on  comparative  changes 
in  this  distribution,  fcbtaaka  are  as  in  Task  n  with  an  additional  one  involving 
a  decision  a*  to  the  form  in  which  the  subject  will  estimate  the  probability  dis¬ 
tribution. 

From  this  game,  in  addition  to  results  of  the  forma  (1)  and  (2),  analogs  of 
(4)  and  (5)  should  bo  available  in  a  time-prediction  oontext.  The  matrix  format 
of  Section  7,  although  presented  in  a  two-party  situation,  would  probably  be 
suitable  for  organizing  input  data  in  this  one-party  situation  also. 
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Task  V;  Revision  of  Prior  Probability  Distribution  in  a  Competitive 
Industrial  Context. 

This  task  repeats  IV  with  the  indicated  shift  in  environment,  it  ce*  i  i  he 
played  as  a  two-party  game  and  provide  an  environment  changing  in  "re^ 
time.  " 


8.3  ONF- PARTY  GAMING  BASED  ON  AN  INFORMATION  MATRIX 

This  section  discusses  how  input  information  organised  in  matrix  form 
might  be  used  in  one-party  gaming.  The  discussion  is  necessarily  preliminary 
in  nature. 

Wo  begin  with  the  definition:  a  new  product-device  line-item  is  called  a 
technological  breakthrough  if  its  appearance  at  time  t  +  1  evokes  ut  least  one 
r,ew  descriptor  not  needed  at  time  t.  The  player  is  given  $I>  and  filled  infor¬ 
mation  matrices  corresponding  to  time  to,  ....  <m.  He  is  also  given  an  ojpfKi- 
tunity  to  purchase  documents.  For  this  purpose,  documents  are  brief  sum¬ 
maries  presenting  information  about  research  line-items.  He  purchases  as 
many  of  these  as  he  wishes  at  time  t^  Identifies  research  line-items,  adds 
these  to  his  matrix  together  with  any  relevant  data  and  time  estimates,  and 
scans  the  docummta  for  hints  at  possible  forthcoming  breakthroughs.  He  may 
then  either  predict  a  breakthrough  and  give  a  time  estimate  or  he  may  not  do 
so. 


Ir.  this  game  there  la  no  pi  salty  far  fall  lag  to  make  a  prediction.  The  only 
penalty  is  ooa  of  $Z  if  a  breakthrough  ooours  at  time  tn+k  which  hac  not  been 
predicted.  And  a  payoff  of  $Y  ooours  if  the  breakthrough  is  predic'  id  properly 
both  as  to  type  and  as  to  timing. 

Let  us  translate  this  game  into  apootfio  terms.  Ilw  player  is  given  $J> 
and  filled  information  matrices  for  the  times  Jtuoary  1.  19M  to  January  l, 
I960.  The  object  Is  prediction  of  breakthroughs  by  DM  in  the  'large"  com¬ 
puter  area.  Heooe  the  matrioes  have  large  IBM  oomputsra  as  lino-items  and 
appropriate  descriptors  as  oolamn  bands.  Tbs  dooumsnfa  which  can  bs  pur¬ 
chased  are  summaries  of  actual  reports,  arttoias,  ate.  appssring  do.  ng  1960 
and  relating  (or  purporting  to  relate)  to  IBM  large  computer  research.  These 
are  purchasable  in  random  order,  lbs  player  must  identity  new  large  IBM 
computers  on  the  way,  list  their  attributes,  and  keep  alert  for  new  develop¬ 
ments  that  might  lead  to  a  new  doacrintor  at  a  fitters  time.  He  must  predict 
this  innovation  and  its  time  of  ap'maraaoa  oorroctly  to  achieve  a  payoff.  If  ho 
fails  to  predict,  he  is  penalised. 
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Although  it  is  possible  to  play  games  of  this  nature,  it  may  not  l>e  desir¬ 
able  to  do  so.  The  preparation  of  the  needed  documents  world  be  a  vory  con- 
eidersble  job  and  would  have  to  he  done  in  a  most  painstaking  manner  if  this 
game  wore  to  be  a  useful  one.  it  is  not  too  much  to  say  th^.  ”  value  of  the 
game  depends  almost  wholly  on  the  job  of  document  preparation  it  may  be 
that  the  time  invol.  ed  could  be  be  tter  spent  in  using  the  information  network  m 
real  time  to  predict  breakthroigts  in  a  few  areas  by  actual  literature  monitor¬ 
ing.  At  the  moment,  the  value  '  this  gaming  situation  .ies  with  actual  real¬ 
time  situations  which  already  use  information  networks  for  human  forecasting, 
where  the  j&me  can  be  prepared  inexpensively  and  the  results  (and  tech¬ 
niques)  of  the  gaming  can  be  compared  and  contrasted  with  the  analysts'  use  of 
the  information  files. 

8.*  rtiE  STRUCTURE  OF  A  FORECASTING  GAME 


The  environment  is  assumed  to  follow  the  formula: 

y(t)  -  Ut)  +  f„(t)  +  f„(t)  -r  #  ft)  +  c 


where 

fr(t)  -  10  sin  Xx  t 

f2W  “  x2  aiD  *  +  2* 
Aj-1,  OS  t»*  8 

Xj  -  2,  9  *  t*  *  1« 

Xj- 8.17S  t'  S  »* 

Xj  •  4,  25  S  t»  S  3« 

X2-  1,  0_t’,..18 

A.  ■  0. 5,17  _  t'  _  32 
i 


f3<t)  -  30  ♦  X3  t 

f4(t)-iox4 

x,-0  , 

o  s  t»  S  4 

X,  -  .*0  . 

5St'S8 

Xj  * .60  , 

»  St'S  12 

Ag  -  .80  , 

13  S  t'  S  1C 

Xg-.W  , 

17  S  t'  *  20 

Xg  -  .95  , 

21  S  t'  S  24 

vM  - 

26  S  t»  <  28 

Xj“  1.00, 

29  SI'S  32 
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x4-.i 

0  S  t*  S  9 

e  :  N(0,  4) 

X  .  *  i.  00  , 

4 

10  <  t*  S  26 

X4-i0  , 

26  <  t*  <  32 

y(t)  Is  computed  for  0  <  t'  <  32 

addition  «ve  have  the  functions  j^<A  i  = 

1,  2,  3,  4,  as  follows 

W  - 1  Vh 

> 

5* 

f< 

( 

o 

H 

li 

r< 

• 

J4(X4)-8X4 

7>.c  jj(A .)  are  also  computed  for  0  s  t1  s  32. 

The  player  io  given  y(t)  from  t’  ■  0  to  t'  *  16.  He  m«y  purchase  informs  - 
tioi,  on  tlie  jj(A t)  before  each  prediction.  Prices  should  be  low  relative  to  the 
playei  *s  initial  bankroll.  Suppose  that  he  starts  with  $400  and  that  information 
coats  $1. 00  per  bit.  Suppose  also  that  he  receives  $50  for  each  prediction 
which  misses  by  less  than  3  units,  zero  dollars  tor  those  between  S  and  5,  and 
loses  $10  if  his  prediction  misses  by  more  than  6  units. 

This  game  entalla  a  very  rudimentary  attempt  to  simulate  a  breakthrough 
when  this  phenomenon  ia  viewed  as  an  abrupt  change  in  one  of  the  parameters 
of  an  observed  system.  For  example,  the  parameter  x4  is  varied  in  a  stepwise 
fash*?  i,  a  d  the  intent  of  the  game  ia  to  identify  players  who  adjust  their  pre¬ 
dictions  rapidly  to  the  change.  There  are  dearly  many  variations  possible. 
Later  gaming  would  consider  a  breakthrough  aa  a  continuous  p roosts. 
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notation  to  describe  a  technology.  An  example  of  a  forecast  of  com¬ 
puter  tcchnolomy  made  several  years  ago  is  included. 
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